-- Logs begin at Sat 2022-06-25 15:16:57 UTC, end at Sat 2022-06-25 16:25:25 UTC. -- Jun 25 15:57:48.196306 dv-cinder-847620-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 25 15:57:48.205912 dv-cinder-847620-2-iscsi devstack@n-api.service[103274]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 25 15:57:48.207255 dv-cinder-847620-2-iscsi devstack@n-api.service[103274]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jun 25 15:57:48 2022] *** Jun 25 15:57:48.207255 dv-cinder-847620-2-iscsi devstack@n-api.service[103274]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 25 15:57:48.207255 dv-cinder-847620-2-iscsi devstack@n-api.service[103274]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 25 15:57:48.207255 dv-cinder-847620-2-iscsi devstack@n-api.service[103274]: nodename: dv-cinder-847620-2-iscsi Jun 25 15:57:48.207255 dv-cinder-847620-2-iscsi devstack@n-api.service[103274]: machine: x86_64 Jun 25 15:57:48.207255 dv-cinder-847620-2-iscsi devstack@n-api.service[103274]: clock source: unix Jun 25 15:57:48.207255 dv-cinder-847620-2-iscsi devstack@n-api.service[103274]: pcre jit disabled Jun 25 15:57:48.207255 dv-cinder-847620-2-iscsi devstack@n-api.service[103274]: detected number of CPU cores: 4 Jun 25 15:57:48.207255 dv-cinder-847620-2-iscsi devstack@n-api.service[103274]: current working directory: / Jun 25 15:57:48.207255 dv-cinder-847620-2-iscsi devstack@n-api.service[103274]: detected binary path: /usr/bin/uwsgi-core Jun 25 15:57:48.207255 dv-cinder-847620-2-iscsi devstack@n-api.service[103274]: your processes number limit is 47680 Jun 25 15:57:48.207255 dv-cinder-847620-2-iscsi devstack@n-api.service[103274]: your memory page size is 4096 bytes Jun 25 15:57:48.207255 dv-cinder-847620-2-iscsi devstack@n-api.service[103274]: detected max file descriptor number: 2048 Jun 25 15:57:48.207255 dv-cinder-847620-2-iscsi devstack@n-api.service[103274]: lock engine: pthread robust mutexes Jun 25 15:57:48.208668 dv-cinder-847620-2-iscsi devstack@n-api.service[103274]: thunder lock: enabled Jun 25 15:57:48.208668 dv-cinder-847620-2-iscsi devstack@n-api.service[103274]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 25 15:57:48.208668 dv-cinder-847620-2-iscsi devstack@n-api.service[103274]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 25 15:57:48.250385 dv-cinder-847620-2-iscsi devstack@n-api.service[103274]: Python main interpreter initialized at 0x55e81c30e9c0 Jun 25 15:57:48.250385 dv-cinder-847620-2-iscsi devstack@n-api.service[103274]: python threads support enabled Jun 25 15:57:48.250385 dv-cinder-847620-2-iscsi devstack@n-api.service[103274]: your server socket listen backlog is limited to 100 connections Jun 25 15:57:48.250385 dv-cinder-847620-2-iscsi devstack@n-api.service[103274]: your mercy for graceful operations on workers is 90 seconds Jun 25 15:57:48.250739 dv-cinder-847620-2-iscsi devstack@n-api.service[103274]: mapped 403077 bytes (393 KB) for 2 cores Jun 25 15:57:48.250739 dv-cinder-847620-2-iscsi devstack@n-api.service[103274]: *** Operational MODE: preforking *** Jun 25 15:57:48.251030 dv-cinder-847620-2-iscsi devstack@n-api.service[103274]: *** uWSGI is running in multiple interpreter mode *** Jun 25 15:57:48.251030 dv-cinder-847620-2-iscsi devstack@n-api.service[103274]: spawned uWSGI master process (pid: 103274) Jun 25 15:57:48.251229 dv-cinder-847620-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 25 15:57:48.253428 dv-cinder-847620-2-iscsi devstack@n-api.service[103274]: spawned uWSGI worker 1 (pid: 103275, cores: 1) Jun 25 15:57:48.253428 dv-cinder-847620-2-iscsi devstack@n-api.service[103274]: spawned uWSGI worker 2 (pid: 103276, cores: 1) Jun 25 15:57:48.253428 dv-cinder-847620-2-iscsi devstack@n-api.service[103274]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 25 15:57:48.902027 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 25 15:57:48.921723 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 25 15:57:50.016298 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 25 15:57:50.016298 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: from cryptography.utils import int_from_bytes Jun 25 15:57:50.017002 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 25 15:57:50.017002 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: from cryptography.utils import int_from_bytes Jun 25 15:57:50.037265 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 25 15:57:50.037265 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: from cryptography.utils import int_from_bytes Jun 25 15:57:50.037755 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 25 15:57:50.037755 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: from cryptography.utils import int_from_bytes Jun 25 15:57:52.468552 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 25 15:57:52.469130 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 25 15:57:52.469286 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 25 15:57:52.469679 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 25 15:57:52.469937 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 25 15:57:52.470362 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.470802 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.471157 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.471473 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.471806 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.472116 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.472440 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.472768 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.473098 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.473365 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.473680 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.474002 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847620-2-iscsi {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.474322 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.474627 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.474908 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 25 15:57:52.475282 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.475369 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 25 15:57:52.475446 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.475532 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.475733 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 25 15:57:52.475820 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.476086 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 25 15:57:52.476181 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.476345 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 25 15:57:52.476619 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.476762 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.477057 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.477164 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.477363 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.477469 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.477673 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.477775 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.478009 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.478116 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.478323 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.478417 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.478630 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.478722 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.478946 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.479044 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.479251 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.479339 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.479525 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.479619 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.479844 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.479928 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.480173 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847620-2-iscsi {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.480258 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847620-2-iscsi {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.480530 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.480625 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.480834 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.480954 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.481148 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.481241 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.481467 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.481562 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.481774 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.481859 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.482098 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.482187 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.482417 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.482520 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.482782 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.482922 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.483092 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.483233 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.483417 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.483567 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.483739 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.483858 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.484061 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.484200 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.484380 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.484550 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.484707 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.484861 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.485015 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.485185 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.485322 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.485502 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.485707 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.486130 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.486440 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.486522 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.486694 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.486778 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.487004 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.487184 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847620-2-iscsi {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.487329 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.487511 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.487651 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.487832 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.487973 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.488155 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.488250 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.488486 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.488602 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.488806 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.488924 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.489126 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.489243 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.489433 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.489571 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.489742 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.489900 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.490049 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.490217 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.490354 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.490555 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.490650 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.490878 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.491008 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.491205 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.491289 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.491530 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.491626 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.491837 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.491920 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.492149 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.492232 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.492482 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.492567 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.492793 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.492874 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.493107 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.493266 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.493417 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.493501 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.493672 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.493758 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.493983 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.494090 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.494310 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.494392 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.494635 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.494717 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.494942 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.495074 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.495199 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.495289 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.495454 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.495543 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.495782 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.495866 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.496106 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.496190 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.496459 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.496546 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.496750 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.496835 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.497061 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.497152 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.497371 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.497454 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.497617 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.497700 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.497916 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.498012 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.498219 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.498315 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.498533 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.498615 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.498835 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.498925 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.499138 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.499229 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.499440 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.499531 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.499739 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.499822 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.500039 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.500131 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.500342 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.500491 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.500748 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.500841 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.501048 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.501185 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.501415 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.501719 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.501949 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.502037 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.502223 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.502320 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.502543 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.502634 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.502871 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.502955 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.503198 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.503281 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.503497 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.503588 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.503801 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.503883 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.504101 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.504187 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.504402 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.504527 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.504740 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.504831 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.505044 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.505172 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.505316 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.505398 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.505622 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.505705 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.505936 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.506019 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.506239 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.506320 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.506552 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.506639 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.506859 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.506953 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.507164 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.507247 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.507465 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.507555 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.507768 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.507852 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.508073 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.508162 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.508377 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.508491 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.508705 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.508788 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.509009 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.509091 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.509308 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.509400 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.509608 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.509691 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.509909 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.509992 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.510211 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.510305 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.510509 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.510600 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.510811 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.510906 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.511107 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.511199 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.511422 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.511503 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.511729 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.511825 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.512032 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.512140 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.512335 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.512458 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.512664 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.512748 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.512971 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.513066 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.513297 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.513380 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.513607 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.513692 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.513916 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.514009 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.514236 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.514335 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.514545 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.514638 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.514853 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.514937 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.515173 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.515257 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.515480 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.515565 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.516130 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.516229 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.516465 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.516552 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.516808 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.516974 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.517180 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.517433 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.517576 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.517749 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.517893 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.518064 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.518204 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.518392 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.518515 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.518708 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.518825 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.519023 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.519135 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.519338 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.519443 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.519649 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.519732 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.519963 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.520054 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.520291 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.520386 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.520637 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.520825 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.520943 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.521026 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.521278 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.521402 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.521608 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 15:57:52.521699 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.521916 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.521998 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.522239 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.522346 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.522556 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.522641 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.522866 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.522950 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.523174 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.523256 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.523483 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.523579 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.523841 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.523925 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.524171 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.524313 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.524523 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.524660 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.524791 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.524926 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.525102 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.525232 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.525414 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.525555 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.525721 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.525848 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.526035 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.526173 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.526344 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.526485 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.526676 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.526805 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.526986 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.527127 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.527298 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.527436 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.527607 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.527734 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.527920 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.528049 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.528229 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.528376 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.528561 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.528701 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.528870 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.529000 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.529172 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.529303 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.529476 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.529601 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.529781 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.529911 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.530087 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.530218 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.530388 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.530514 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.530707 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.530846 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.531030 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.531165 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.531333 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.531485 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.531664 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.531798 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.531970 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.532100 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.532280 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.532480 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.532744 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.532983 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.533114 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.533358 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.533488 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.533668 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.533798 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.533980 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.534125 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.534285 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.534410 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.534606 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.534760 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.534916 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.535043 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.535221 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.535351 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.535540 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.535636 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.535851 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.535962 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.536164 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.536284 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.536505 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.536635 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.536820 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.536954 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.537130 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.537273 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.537441 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.537590 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.537752 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.537905 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.538076 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.538231 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.538392 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.538526 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.538704 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.538843 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.539037 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.539152 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.539371 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.539479 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.539676 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.539810 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.539997 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.540122 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.540319 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.540490 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.540669 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.540802 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.540970 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.541127 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.541280 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.541444 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.541598 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.541760 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.541888 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.542074 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.542201 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.542390 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.542516 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.542708 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.542846 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.543019 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.543146 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.543323 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.543459 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.543627 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.543758 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.543961 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.544092 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.544235 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.544356 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.544556 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.544643 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.544862 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.544954 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.545169 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.545253 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.545473 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.545564 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.545793 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.545883 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.546106 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.546189 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.546421 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.546514 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.546750 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.546833 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.547070 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.547154 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.547386 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.547477 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.547694 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.547784 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.548009 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.548139 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.548576 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.548896 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.548990 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.549209 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.549301 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.549521 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.549614 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.549842 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.549932 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.550152 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.550235 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.550475 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.550568 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.550785 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.550867 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.551099 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.551183 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.551411 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.551506 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.551727 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.551812 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.552031 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.552119 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.552337 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.552475 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.552674 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.552769 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.552985 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.553070 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.553294 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.553378 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.553626 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.553717 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.553933 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.554016 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.554242 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.554325 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.554548 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.554629 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.554852 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.554934 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.555158 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.555252 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.555469 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.555552 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.555790 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.555922 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.556106 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.556238 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.556444 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.556557 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.556761 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.556850 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.557084 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.557174 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.557394 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.557488 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.557711 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.557807 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.558016 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.558109 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.558329 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.558417 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.558646 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.558748 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.558972 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.559057 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.559279 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.559362 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.559589 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.559683 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.559901 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.559985 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.560211 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.560302 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.560554 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.560660 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.560868 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.560960 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.561173 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.561258 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.561480 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.561585 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.561787 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.561885 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.562103 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.562187 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.562412 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.562506 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.562723 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.562814 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.563027 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.563111 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.563342 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.563436 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.563650 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.563734 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.563994 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.564303 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.564482 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.564630 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.564818 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.564953 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.565143 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.565264 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.565474 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.565585 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.565802 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.565908 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.566129 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.566225 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.566447 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.566541 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.566780 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.566865 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.567096 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.567190 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.567399 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.567494 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.567705 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.567798 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.568008 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.568108 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.568346 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.568463 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.568699 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.568785 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.569005 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.569098 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.569367 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.569469 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.569637 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.569722 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.569947 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.570041 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.570258 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.570344 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.570568 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.570653 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.570876 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.570960 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.571186 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.571270 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.571499 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.571616 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.571809 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.571937 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.572118 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.572203 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.572451 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.572551 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.572753 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.572844 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.573059 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.573149 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.573372 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.573540 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.573680 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.573762 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.573986 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.574070 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.574291 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.574381 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.574594 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.574680 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.574902 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.574993 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.575221 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.575312 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.575550 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.575794 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.575919 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.576134 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.576218 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.576468 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.576554 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.576789 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.576870 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.577098 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.577208 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.577405 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.577497 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.577713 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.577803 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.578042 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.578138 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.578359 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.578450 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.578668 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.578761 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.578974 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.579057 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.579296 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.579407 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.579630 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.579943 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.580125 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.580247 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.580483 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.580572 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.580812 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.580896 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.581138 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.581224 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.581455 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.581549 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.581760 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.581850 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.582061 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.582154 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.582364 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.582461 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.582677 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.582760 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.582978 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.583071 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.583284 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.583369 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.583586 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.583669 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.583908 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.583999 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.584216 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.584301 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.584542 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.584670 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.584846 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.584948 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.585149 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.585234 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.585470 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.585559 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.585781 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.586052 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.586135 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.586392 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.586475 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.586712 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.586805 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.587038 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.587130 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.587345 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.587428 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.587665 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.587757 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.587969 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.588053 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.588273 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.588356 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.588601 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.588703 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.588912 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.589005 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.589221 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.589306 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.589523 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.589613 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.589832 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.589916 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.590139 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.590222 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.590447 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.590531 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.590753 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.590838 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.591054 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.591138 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.591361 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.591453 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.591667 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.591785 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.591974 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.592057 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.592280 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.592453 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.592591 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.592722 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.592898 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.593025 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.593206 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.593345 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.593515 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.593654 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.593817 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.593959 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.594125 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.594272 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.594427 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.594558 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.594736 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.594866 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.595063 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.595191 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.595368 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.595673 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.595863 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.595989 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.596230 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.596359 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.596574 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.596708 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.596910 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.597041 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.597224 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.597355 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.597529 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.597654 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.597831 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.597958 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.598171 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.598301 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.598429 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.598567 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.598720 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.598858 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.599029 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.599159 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.599350 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.599480 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.599665 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.599798 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.599968 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.600113 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.600277 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.600402 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.600605 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.600742 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.600909 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.601036 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.601214 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.601347 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.601524 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.601657 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.601825 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.601951 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.602128 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.602273 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.602427 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.602555 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.602730 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.602857 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.603030 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.603158 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.603338 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.603464 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.603646 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.603773 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.603946 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.604080 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.604247 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.604375 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.604576 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.604701 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.604889 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.604975 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.605198 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.605283 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.605521 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.605604 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.605833 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.605925 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.606140 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.606223 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.606448 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.606530 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.606756 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.606846 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.607064 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.607155 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.607369 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.607452 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.607670 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.607760 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.607989 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.608072 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.608296 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.608378 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.608627 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.608726 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.608927 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.609012 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.609230 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.609314 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.609534 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.609617 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.609844 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.609934 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.610157 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.610295 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.610467 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.610631 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.610835 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.611159 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.611316 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.611461 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.611649 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.611770 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.611966 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.612079 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.612284 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.612376 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.612629 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.612715 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.612948 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.613031 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.613261 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.613353 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.613576 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.613660 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.613890 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.613974 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.614199 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.614291 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.614507 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.614592 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.614814 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.614906 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.615123 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.615217 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.615431 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.615514 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.615733 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.615818 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.616047 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.616139 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.616358 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.616550 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.616682 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.616812 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.616983 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.617117 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.617286 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.617411 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.617595 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.617721 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.617898 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.618029 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.618285 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.618414 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.618602 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.618731 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.618923 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.619049 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.619228 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.619360 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.619538 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.619668 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.619848 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.619975 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.620163 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.620304 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.620493 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.620629 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.620799 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.620928 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.621124 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.621252 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.621440 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.621578 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.621753 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.621892 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.622079 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.622206 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.622417 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.622558 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.622689 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.622825 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.622994 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.623122 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.623314 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.623447 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.623619 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.623755 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.623922 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.624053 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.624226 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.624364 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.624558 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.624693 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.624866 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.624990 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.625178 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.625315 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.625494 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.625626 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.625814 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.625940 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.626128 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.626290 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.626597 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.626907 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.627003 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.627217 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.627422 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.627556 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.627682 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.627842 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.627968 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.628163 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.628292 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.628489 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.628633 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.628806 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.628977 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.629118 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.629203 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.629442 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.629535 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.629766 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.629849 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.630076 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.630161 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.630389 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.630515 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.630694 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.630834 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.631014 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.631150 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.631336 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.631463 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.631647 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.631782 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.631966 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.632101 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.632376 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.632504 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.632723 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.632819 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.633050 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.633147 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.633354 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.633461 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.633679 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.633773 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.633985 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.634069 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.634289 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.634380 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.634601 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.634710 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.634905 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.635003 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.635208 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.635293 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.635530 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.635622 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.635842 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.635938 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.636151 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.636235 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.636482 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.636571 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.636793 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.636888 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.637097 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.637182 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.637397 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.637481 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.637720 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.637835 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.638024 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.638157 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.638347 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.638467 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.638659 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.638890 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.639011 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.639214 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.639299 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.639529 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.639630 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.639859 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.639943 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.640179 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.640270 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.640505 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.640593 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.641137 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.641221 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.641439 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.641522 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.641786 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.642014 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.642105 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.642451 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.642700 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.642827 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.643049 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.643142 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.643369 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.643456 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.643699 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.643784 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.644021 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.644131 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.644338 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.644519 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.644680 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.644820 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.645005 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.645134 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.645308 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.645449 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.645613 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.645748 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.645928 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.646060 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.646232 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.646362 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.646534 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.646686 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.646839 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.647015 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.647149 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.647331 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.647474 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.647644 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.647782 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.647961 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.648087 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.648275 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.648432 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.648613 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.648740 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.648942 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.649040 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.649250 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.649384 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.649553 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.649733 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.649867 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.649996 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.650149 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.650288 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.650463 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.650593 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.650772 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.650902 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.651098 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.651237 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.651408 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.651556 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.651725 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.651855 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.652041 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.652171 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.652348 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.652506 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.652699 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.652829 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.653008 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.653093 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.653318 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.653400 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.653634 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.653717 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.653944 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.654030 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.654252 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.654335 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.654561 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.654645 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.654872 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.654956 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.655184 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.655267 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.655496 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.655590 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.655815 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.655900 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.656132 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.656225 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.656487 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.656673 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.656827 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.657001 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.657159 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.657315 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.657514 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.657689 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.657951 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.658263 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.658346 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.658572 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.658665 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.658883 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.658968 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.659189 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.659274 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.659501 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.659594 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.659808 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.659900 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.660119 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.660204 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.660446 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.660546 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.660767 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.660853 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.661076 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.661167 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.661388 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.661485 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.661696 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.661780 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.662011 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.662093 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.662315 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.662399 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.662641 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.662737 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.662957 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.663088 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.663262 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.663392 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.663568 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.663704 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.663877 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.664004 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.664188 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.664317 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.664526 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.664666 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.664836 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.664978 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.665150 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.665280 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.665458 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.665593 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.665772 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.665919 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.666082 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.666212 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.666394 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.666531 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.666706 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.666805 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.667031 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.667156 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.667350 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.667482 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.667698 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.667827 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.667962 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.668090 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.668262 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.668388 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.668605 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.668732 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.668916 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.669126 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.669231 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.669442 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.669599 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.669775 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.669860 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.670098 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.670360 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.670445 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.670696 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.670781 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.671014 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.671098 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.671335 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.671429 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.671640 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.671723 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.671946 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.672030 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.672260 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.672352 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.672596 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.672682 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.672904 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.673048 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.673302 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.673469 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.673615 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.674027 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.674172 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.674355 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.674522 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.674668 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.674859 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.675197 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.675280 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.675751 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.675882 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.675988 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.676072 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.676179 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.676272 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.676525 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.676625 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.676844 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.676968 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.677151 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.677237 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.677475 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.677569 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.677783 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.677868 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.678091 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.678175 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.678409 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.678498 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.678720 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.678804 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.679026 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.679111 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.679333 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.679426 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.679645 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.679729 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.679953 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.680036 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.680259 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.680344 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.680603 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.680688 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.680910 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.681004 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.681230 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.681321 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.681535 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.681619 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.681845 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.681946 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.682155 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.682239 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.682467 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.682559 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.682771 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.682911 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.683073 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.683200 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.683377 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.683628 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.683889 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.684027 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.684157 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.684298 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.684470 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.684608 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.684747 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.684877 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.685007 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.685178 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.685317 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.685482 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.685620 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.685798 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.685937 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.686152 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.686292 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.686472 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.686614 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.686774 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.686906 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.687077 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.687208 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.687387 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.687516 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.687697 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.687826 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.688019 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.688156 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.688326 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.688474 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.688675 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.688831 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.689129 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.689511 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.689648 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.690065 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.690193 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.690429 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.690566 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.690759 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.690913 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.691095 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.691225 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.691429 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.691570 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.691736 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.691865 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.692044 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.692177 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.692350 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.692498 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.692707 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.692834 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.693018 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.693128 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.693330 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.693457 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.693642 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.693773 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.693954 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.694083 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.694261 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.694402 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.694572 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.694711 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.694881 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.695019 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.695190 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.695329 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.695499 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.695638 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.695808 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.695938 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.696122 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.696263 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.696450 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.696583 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.696764 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.696906 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.697075 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.697211 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.697396 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.697523 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.697707 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.697833 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.698040 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.698170 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.698319 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.698445 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.698630 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.698760 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.698940 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.699079 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.699248 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.699377 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.699553 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.699679 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.699858 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.699990 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.700170 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.700300 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.700500 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.700628 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.700819 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.700953 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.701123 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.701249 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.701495 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.701628 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.701807 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.701934 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.702115 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.702243 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.702434 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.702573 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.702743 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.702883 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.703063 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.703189 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.703378 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.703474 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.703685 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.703769 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.704006 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.704091 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.704359 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.704467 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.704863 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.705202 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.705422 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.705532 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.705777 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.705871 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.706111 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.706196 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.706443 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.706528 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.706748 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.706842 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.707054 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.707140 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.707372 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.707466 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.707683 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.707770 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.707989 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.708073 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.708291 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.708384 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.708629 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.708715 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.708934 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.709020 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.709238 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.709332 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.709541 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.709627 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.709841 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.709926 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.710148 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.710242 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.710449 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.710536 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.710751 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.710835 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.711052 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.711145 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.711352 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.711436 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.711654 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.711738 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.711957 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.712042 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.712263 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.712348 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.712590 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.712677 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.712892 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.712978 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.713195 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.713287 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.713496 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.713583 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.713796 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.713881 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.714129 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.714213 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.714461 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.714554 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.714776 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.714860 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.715087 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.715169 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.715393 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.715526 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.715713 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.715797 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.716024 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.716109 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.716342 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.716488 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.716690 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.716794 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.717002 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.717115 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.717309 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.717445 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.717637 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.717772 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.717945 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.718090 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.718255 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.718421 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.718610 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.718754 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.718871 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.719071 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.719164 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.719404 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.719496 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.719721 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.719805 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.720081 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.720248 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.720644 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.720973 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.721060 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.721289 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.721386 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.721609 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.721695 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.721925 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.722009 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.722234 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.722327 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.722555 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.722639 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.722861 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.722944 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.723170 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.723269 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.723482 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.723566 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.723789 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.723874 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.724098 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.724184 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.724448 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.724535 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.724748 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.724833 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.725059 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.725144 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.725374 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.725466 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.725682 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.725765 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.725995 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.726080 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.726311 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.726396 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.726622 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.726706 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.726931 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.727020 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.727240 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.727324 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.727552 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.727714 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.727861 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.727946 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.728176 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.728261 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.728509 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.728612 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.728756 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 25 15:57:52.728842 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.729113 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.729420 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.729729 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.730069 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.730409 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.730733 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.731065 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.731382 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.731712 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.732028 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.732356 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.732709 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.733030 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.733345 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.733682 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.733997 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.734313 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.734628 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.734940 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.735255 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.735751 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.736564 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.736906 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.737222 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.737560 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.737889 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.738218 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.738542 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.738863 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.739201 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.739519 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.739837 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.740160 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.740500 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.740821 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.741145 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.741468 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.741803 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.742135 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.742453 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.742788 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.743123 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.743477 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.743798 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.744150 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.744516 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.744831 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.745148 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.745458 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 15:57:52.745707 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 25 15:57:52.811033 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO dbcounter [None req-02fd6b77-2edf-4506-8691-96098f7cf420 None None] Registered counter for database nova_api Jun 25 15:57:52.883764 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO dbcounter [None req-089441f0-a93d-4aa8-9453-1655792db549 None None] Registered counter for database nova_api Jun 25 15:57:52.906619 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG oslo_db.sqlalchemy.engines [None req-089441f0-a93d-4aa8-9453-1655792db549 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103276) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 15:57:52.913669 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG dbcounter [-] [103276] Writer thread running {{(pid=103276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 15:57:52.928641 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_db.sqlalchemy.engines [None req-02fd6b77-2edf-4506-8691-96098f7cf420 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103275) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 15:57:52.935119 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG dbcounter [-] [103275] Writer thread running {{(pid=103275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 15:57:52.972513 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.context [None req-089441f0-a93d-4aa8-9453-1655792db549 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),53447464-e1f9-46ac-a935-41c9e2d241f6(cell1) {{(pid=103276) load_cells /opt/stack/nova/nova/context.py:464}} Jun 25 15:57:52.976388 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG oslo_concurrency.lockutils [None req-089441f0-a93d-4aa8-9453-1655792db549 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 15:57:52.977972 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG oslo_concurrency.lockutils [None req-089441f0-a93d-4aa8-9453-1655792db549 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 15:57:52.978738 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG oslo_concurrency.lockutils [None req-089441f0-a93d-4aa8-9453-1655792db549 None None] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 15:57:52.980707 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG oslo_concurrency.lockutils [None req-089441f0-a93d-4aa8-9453-1655792db549 None None] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 15:57:52.982695 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO dbcounter [None req-089441f0-a93d-4aa8-9453-1655792db549 None None] Registered counter for database nova_cell0 Jun 25 15:57:52.987251 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO dbcounter [None req-089441f0-a93d-4aa8-9453-1655792db549 None None] Registered counter for database nova_cell1 Jun 25 15:57:52.995402 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.context [None req-02fd6b77-2edf-4506-8691-96098f7cf420 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),53447464-e1f9-46ac-a935-41c9e2d241f6(cell1) {{(pid=103275) load_cells /opt/stack/nova/nova/context.py:464}} Jun 25 15:57:52.995585 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG oslo_db.sqlalchemy.engines [None req-089441f0-a93d-4aa8-9453-1655792db549 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103276) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 15:57:52.996502 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG oslo_db.sqlalchemy.engines [None req-089441f0-a93d-4aa8-9453-1655792db549 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103276) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 15:57:52.997870 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-02fd6b77-2edf-4506-8691-96098f7cf420 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 15:57:52.999489 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-02fd6b77-2edf-4506-8691-96098f7cf420 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 15:57:53.000303 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-02fd6b77-2edf-4506-8691-96098f7cf420 None None] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 15:57:53.002461 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG dbcounter [-] [103276] Writer thread running {{(pid=103276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 15:57:53.003171 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-02fd6b77-2edf-4506-8691-96098f7cf420 None None] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 15:57:53.004215 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG dbcounter [-] [103276] Writer thread running {{(pid=103276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 15:57:53.005262 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO dbcounter [None req-02fd6b77-2edf-4506-8691-96098f7cf420 None None] Registered counter for database nova_cell0 Jun 25 15:57:53.009255 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO dbcounter [None req-02fd6b77-2edf-4506-8691-96098f7cf420 None None] Registered counter for database nova_cell1 Jun 25 15:57:53.016941 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_db.sqlalchemy.engines [None req-02fd6b77-2edf-4506-8691-96098f7cf420 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103275) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 15:57:53.020675 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_db.sqlalchemy.engines [None req-02fd6b77-2edf-4506-8691-96098f7cf420 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103275) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 15:57:53.024006 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG dbcounter [-] [103275] Writer thread running {{(pid=103275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 15:57:53.151914 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO dbcounter [None req-089441f0-a93d-4aa8-9453-1655792db549 None None] Registered counter for database nova_cell0 Jun 25 15:57:53.161580 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG oslo_db.sqlalchemy.engines [None req-089441f0-a93d-4aa8-9453-1655792db549 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103276) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 15:57:53.167185 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG dbcounter [-] [103276] Writer thread running {{(pid=103276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 15:57:53.169614 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG dbcounter [-] [103275] Writer thread running {{(pid=103275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 15:57:53.180792 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO dbcounter [None req-02fd6b77-2edf-4506-8691-96098f7cf420 None None] Registered counter for database nova_cell0 Jun 25 15:57:53.189807 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_db.sqlalchemy.engines [None req-02fd6b77-2edf-4506-8691-96098f7cf420 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103275) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 15:57:53.195290 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG dbcounter [-] [103275] Writer thread running {{(pid=103275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 15:57:53.504353 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: WARNING keystonemiddleware.auth_token [None req-02fd6b77-2edf-4506-8691-96098f7cf420 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 25 15:57:53.505065 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: WARNING keystonemiddleware.auth_token [None req-089441f0-a93d-4aa8-9453-1655792db549 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 25 15:57:53.511816 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: WARNING keystonemiddleware.auth_token [None req-02fd6b77-2edf-4506-8691-96098f7cf420 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 25 15:57:53.512035 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: WARNING keystonemiddleware.auth_token [None req-089441f0-a93d-4aa8-9453-1655792db549 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 25 15:57:53.855199 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: WARNING keystonemiddleware.auth_token [None req-02fd6b77-2edf-4506-8691-96098f7cf420 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 25 15:57:53.861362 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: WARNING keystonemiddleware.auth_token [None req-089441f0-a93d-4aa8-9453-1655792db549 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 25 15:57:53.861471 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: WARNING keystonemiddleware.auth_token [None req-02fd6b77-2edf-4506-8691-96098f7cf420 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 25 15:57:53.866616 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e81c30e9c0 pid: 103275 (default app) Jun 25 15:57:53.867329 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: WARNING keystonemiddleware.auth_token [None req-089441f0-a93d-4aa8-9453-1655792db549 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 25 15:57:53.868772 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-02fd6b77-2edf-4506-8691-96098f7cf420 None None] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 15:57:53.869976 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-02fd6b77-2edf-4506-8691-96098f7cf420 None None] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001815 Jun 25 15:57:53.870388 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 788 bytes} [Sat Jun 25 15:57:53 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 15:57:53.873104 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e81c30e9c0 pid: 103276 (default app) Jun 25 15:59:09.079249 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-02fd6b77-2edf-4506-8691-96098f7cf420 None None] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 15:59:09.080560 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-02fd6b77-2edf-4506-8691-96098f7cf420 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001608 Jun 25 15:59:09.081058 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 2/2] 10.222.0.13 () {54 vars in 930 bytes} [Sat Jun 25 15:59:09 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 15:59:09.097112 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG dbcounter [-] [103276] Writing DB stats nova_api:SELECT=3 {{(pid=103276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 15:59:09.098080 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG dbcounter [-] [103276] Writing DB stats nova_cell0:SELECT=3 {{(pid=103276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 15:59:09.098896 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG dbcounter [-] [103276] Writing DB stats nova_cell1:SELECT=3 {{(pid=103276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 15:59:09.099612 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG dbcounter [-] [103276] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 15:59:09.520338 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-f13b8f44-bd37-4593-bce3-1693bdf81a19 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 15:59:09.552131 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-f13b8f44-bd37-4593-bce3-1693bdf81a19 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.464311 Jun 25 15:59:09.552956 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 1/3] 10.222.0.13 () {60 vars in 1291 bytes} [Sat Jun 25 15:59:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 15:59:11.618924 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-02fd6b77-2edf-4506-8691-96098f7cf420 None None] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 15:59:11.620088 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-02fd6b77-2edf-4506-8691-96098f7cf420 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jun 25 15:59:11.620491 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 3/4] 10.222.0.13 () {54 vars in 930 bytes} [Sat Jun 25 15:59:11 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 15:59:11.681012 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-0795433e-0b47-4387-866e-37543e9a2c1f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "name": "cirros256", "swap": 0, "id": "c1", "disk": 1, "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 15:59:11.698872 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 15:59:11.698872 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: warnings.warn(msg) Jun 25 15:59:11.727641 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-0795433e-0b47-4387-866e-37543e9a2c1f admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.100691 Jun 25 15:59:11.728390 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 2/5] 10.222.0.13 () {64 vars in 1282 bytes} [Sat Jun 25 15:59:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 25 15:59:11.741947 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG dbcounter [-] [103275] Writing DB stats nova_api:SELECT=3 {{(pid=103275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 15:59:11.743134 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG dbcounter [-] [103275] Writing DB stats nova_cell0:SELECT=3 {{(pid=103275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 15:59:11.743979 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG dbcounter [-] [103275] Writing DB stats nova_cell1:SELECT=3 {{(pid=103275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 15:59:11.744991 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG dbcounter [-] [103275] Writing DB stats nova_cell0:SELECT=3 {{(pid=103275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 15:59:11.947650 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-b15e56ab-e909-482b-bce1-e6b8c69ea67c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 15:59:11.950037 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 15:59:11.950037 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: warnings.warn(msg) Jun 25 15:59:12.019179 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-b15e56ab-e909-482b-bce1-e6b8c69ea67c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282379 Jun 25 15:59:12.020540 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 4/6] 10.222.0.13 () {64 vars in 1335 bytes} [Sat Jun 25 15:59:11 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 15:59:14.075510 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-0795433e-0b47-4387-866e-37543e9a2c1f admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 15:59:14.076637 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-0795433e-0b47-4387-866e-37543e9a2c1f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Jun 25 15:59:14.077313 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 3/7] 10.222.0.13 () {54 vars in 930 bytes} [Sat Jun 25 15:59:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 15:59:14.190382 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-f2dcf8da-8bec-49fb-9e7e-6df91a3348a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d1", "name": "ds512M", "swap": 0}} {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 15:59:14.208119 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 15:59:14.208119 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: warnings.warn(msg) Jun 25 15:59:14.228345 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-f2dcf8da-8bec-49fb-9e7e-6df91a3348a4 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.144287 Jun 25 15:59:14.228916 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 5/8] 10.222.0.13 () {64 vars in 1282 bytes} [Sat Jun 25 15:59:14 2022] POST /compute/v2.1/flavors => generated 404 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 15:59:14.241159 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-26a39c0f-0266-4929-95eb-57d1ce433180 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 15:59:14.242676 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 15:59:14.242676 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: warnings.warn(msg) Jun 25 15:59:14.276552 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-26a39c0f-0266-4929-95eb-57d1ce433180 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039052 Jun 25 15:59:14.288434 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 4/9] 10.222.0.13 () {64 vars in 1335 bytes} [Sat Jun 25 15:59:14 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 15:59:16.346975 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-f2dcf8da-8bec-49fb-9e7e-6df91a3348a4 admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 15:59:16.348198 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-f2dcf8da-8bec-49fb-9e7e-6df91a3348a4 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001615 Jun 25 15:59:16.349076 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 6/10] 10.222.0.13 () {54 vars in 930 bytes} [Sat Jun 25 15:59:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 15:59:16.412846 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-31413a82-8787-455c-b554-1e49bf75ebf4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "vcpus": 1, "name": "ds1G"}} {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 15:59:16.432559 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-31413a82-8787-455c-b554-1e49bf75ebf4 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077864 Jun 25 15:59:16.440236 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 5/11] 10.222.0.13 () {64 vars in 1282 bytes} [Sat Jun 25 15:59:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 25 15:59:16.445787 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-b5e48848-65ed-4c96-8d23-e43e874f6612 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 15:59:16.471779 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-b5e48848-65ed-4c96-8d23-e43e874f6612 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030090 Jun 25 15:59:16.472840 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 7/12] 10.222.0.13 () {64 vars in 1335 bytes} [Sat Jun 25 15:59:16 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 15:59:18.542641 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-31413a82-8787-455c-b554-1e49bf75ebf4 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 15:59:18.543657 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-31413a82-8787-455c-b554-1e49bf75ebf4 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jun 25 15:59:18.544043 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 6/13] 10.222.0.13 () {54 vars in 930 bytes} [Sat Jun 25 15:59:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 15:59:18.605677 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-7fcc7c9c-e2df-42ef-b5bd-6b19ae54760d admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d3", "ram": 2048, "name": "ds2G", "vcpus": 2}} {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 15:59:18.625547 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-7fcc7c9c-e2df-42ef-b5bd-6b19ae54760d admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075342 Jun 25 15:59:18.626085 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 8/14] 10.222.0.13 () {64 vars in 1282 bytes} [Sat Jun 25 15:59:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 15:59:18.639382 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-320e7fae-1b02-4f32-a21d-e2222284bec0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 15:59:18.664916 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-320e7fae-1b02-4f32-a21d-e2222284bec0 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029448 Jun 25 15:59:18.665898 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 7/15] 10.222.0.13 () {64 vars in 1335 bytes} [Sat Jun 25 15:59:18 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 15:59:20.740457 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-7fcc7c9c-e2df-42ef-b5bd-6b19ae54760d admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 15:59:20.741542 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-7fcc7c9c-e2df-42ef-b5bd-6b19ae54760d admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001579 Jun 25 15:59:20.741949 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 9/16] 10.222.0.13 () {54 vars in 930 bytes} [Sat Jun 25 15:59:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 15:59:20.804149 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-2b67484e-2955-4c09-b8e9-0104ab3f30c6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "disk": 20, "ram": 4096, "rxtx_factor": 1.0, "vcpus": 4, "swap": 0, "id": "d4", "os-flavor-access:is_public": true}} {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 15:59:20.822327 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-2b67484e-2955-4c09-b8e9-0104ab3f30c6 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074449 Jun 25 15:59:20.822884 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 8/17] 10.222.0.13 () {64 vars in 1282 bytes} [Sat Jun 25 15:59:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 15:59:20.835438 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-2959cd80-cdca-4ef9-ae08-4e58623ee5c2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 15:59:20.862315 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-2959cd80-cdca-4ef9-ae08-4e58623ee5c2 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029980 Jun 25 15:59:20.862542 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 10/18] 10.222.0.13 () {64 vars in 1335 bytes} [Sat Jun 25 15:59:20 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 15:59:22.933784 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-2b67484e-2955-4c09-b8e9-0104ab3f30c6 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 15:59:22.934887 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-2b67484e-2955-4c09-b8e9-0104ab3f30c6 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001533 Jun 25 15:59:22.935356 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 9/19] 10.222.0.13 () {54 vars in 930 bytes} [Sat Jun 25 15:59:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 15:59:22.999068 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-f75ae239-db7e-4fe2-bfa5-72dd6f4569c4 admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 15:59:23.025258 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-f75ae239-db7e-4fe2-bfa5-72dd6f4569c4 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.083755 Jun 25 15:59:23.032532 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 11/20] 10.222.0.13 () {60 vars in 1291 bytes} [Sat Jun 25 15:59:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 15:59:25.119249 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-2b67484e-2955-4c09-b8e9-0104ab3f30c6 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 15:59:25.120219 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-2b67484e-2955-4c09-b8e9-0104ab3f30c6 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jun 25 15:59:25.120746 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 10/21] 10.222.0.13 () {54 vars in 930 bytes} [Sat Jun 25 15:59:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 15:59:25.210898 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-fbb7ad29-080d-42eb-ba51-15f886667e77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "disk": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny"}} {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 15:59:25.231660 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-fbb7ad29-080d-42eb-ba51-15f886667e77 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.104478 Jun 25 15:59:25.232791 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 12/22] 10.222.0.13 () {64 vars in 1282 bytes} [Sat Jun 25 15:59:25 2022] POST /compute/v2.1/flavors => generated 402 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 15:59:25.244299 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-5747bde3-6a02-470e-9110-bf66505158d7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 15:59:25.270975 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-5747bde3-6a02-470e-9110-bf66505158d7 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030282 Jun 25 15:59:25.271826 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 11/23] 10.222.0.13 () {64 vars in 1332 bytes} [Sat Jun 25 15:59:25 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 15:59:27.421236 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-fbb7ad29-080d-42eb-ba51-15f886667e77 admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 15:59:27.422355 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-fbb7ad29-080d-42eb-ba51-15f886667e77 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001756 Jun 25 15:59:27.422759 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 13/24] 10.222.0.13 () {54 vars in 930 bytes} [Sat Jun 25 15:59:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 15:59:27.486745 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-6daef8dd-31a5-4559-a7c3-bc31330f2abd admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "m1.small", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 20}} {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 15:59:27.505760 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-6daef8dd-31a5-4559-a7c3-bc31330f2abd admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076107 Jun 25 15:59:27.506487 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 12/25] 10.222.0.13 () {64 vars in 1282 bytes} [Sat Jun 25 15:59:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 15:59:27.520014 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-f376bb3a-0a0e-4b68-ae59-2c3c78455ca3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 15:59:27.550181 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-f376bb3a-0a0e-4b68-ae59-2c3c78455ca3 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035089 Jun 25 15:59:27.550761 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 14/26] 10.222.0.13 () {64 vars in 1332 bytes} [Sat Jun 25 15:59:27 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 15:59:29.665386 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-6daef8dd-31a5-4559-a7c3-bc31330f2abd admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 15:59:29.666356 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-6daef8dd-31a5-4559-a7c3-bc31330f2abd admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 Jun 25 15:59:29.666880 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 13/27] 10.222.0.13 () {54 vars in 930 bytes} [Sat Jun 25 15:59:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 15:59:29.739969 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-c44def22-9590-4dba-8b74-ded1e41234be admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "rxtx_factor": 1.0, "name": "m1.medium", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "disk": 40, "ram": 4096, "swap": 0}} {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 15:59:29.762624 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-c44def22-9590-4dba-8b74-ded1e41234be admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.089455 Jun 25 15:59:29.763331 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 15/28] 10.222.0.13 () {64 vars in 1282 bytes} [Sat Jun 25 15:59:29 2022] POST /compute/v2.1/flavors => generated 406 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 15:59:29.778800 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-646105f8-1cea-4662-9960-070eb749e489 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 15:59:29.808049 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-646105f8-1cea-4662-9960-070eb749e489 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034016 Jun 25 15:59:29.808842 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 14/29] 10.222.0.13 () {64 vars in 1332 bytes} [Sat Jun 25 15:59:29 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 15:59:31.878668 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-c44def22-9590-4dba-8b74-ded1e41234be admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 15:59:31.879697 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-c44def22-9590-4dba-8b74-ded1e41234be admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001673 Jun 25 15:59:31.880067 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 16/30] 10.222.0.13 () {54 vars in 930 bytes} [Sat Jun 25 15:59:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 15:59:31.943336 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-f9457f40-0454-4955-af48-5c9a76a99282 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 8192, "rxtx_factor": 1.0, "name": "m1.large", "disk": 80, "id": "4", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 15:59:31.963289 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-f9457f40-0454-4955-af48-5c9a76a99282 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.077061 Jun 25 15:59:31.963917 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 15/31] 10.222.0.13 () {64 vars in 1282 bytes} [Sat Jun 25 15:59:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 15:59:31.976374 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-70a7003c-12e4-4576-a4f8-fe9ff011530e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 15:59:32.000194 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-70a7003c-12e4-4576-a4f8-fe9ff011530e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027409 Jun 25 15:59:32.000846 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 17/32] 10.222.0.13 () {64 vars in 1332 bytes} [Sat Jun 25 15:59:31 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 15:59:34.166994 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-f9457f40-0454-4955-af48-5c9a76a99282 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 15:59:34.168036 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-f9457f40-0454-4955-af48-5c9a76a99282 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jun 25 15:59:34.168454 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 16/33] 10.222.0.13 () {54 vars in 930 bytes} [Sat Jun 25 15:59:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 15:59:34.223984 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-2a270b80-6ce1-4d48-b189-000703ae4176 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "vcpus": 8, "id": "5", "rxtx_factor": 1.0, "swap": 0, "ram": 16384, "os-flavor-access:is_public": true}} {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 15:59:34.242822 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-2a270b80-6ce1-4d48-b189-000703ae4176 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.068564 Jun 25 15:59:34.243367 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 18/34] 10.222.0.13 () {64 vars in 1282 bytes} [Sat Jun 25 15:59:34 2022] POST /compute/v2.1/flavors => generated 408 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 25 15:59:34.255337 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-5b492a84-ebd0-4043-b8cf-27c2fa666843 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 15:59:34.279992 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-5b492a84-ebd0-4043-b8cf-27c2fa666843 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028351 Jun 25 15:59:34.280700 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 17/35] 10.222.0.13 () {64 vars in 1332 bytes} [Sat Jun 25 15:59:34 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 15:59:59.115964 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-2a270b80-6ce1-4d48-b189-000703ae4176 admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 15:59:59.117678 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-2a270b80-6ce1-4d48-b189-000703ae4176 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002326 Jun 25 15:59:59.118337 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 19/36] 10.222.0.13 () {54 vars in 930 bytes} [Sat Jun 25 15:59:59 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 15:59:59.129086 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG dbcounter [-] [103276] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 15:59:59.185015 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-b94e8a6f-9c34-4c33-b5bd-85a53865b2de admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 15:59:59.201846 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-b94e8a6f-9c34-4c33-b5bd-85a53865b2de admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.077547 Jun 25 15:59:59.202339 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 18/37] 10.222.0.13 () {60 vars in 1291 bytes} [Sat Jun 25 15:59:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:00:00.123776 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-2a270b80-6ce1-4d48-b189-000703ae4176 admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:00:00.124870 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-2a270b80-6ce1-4d48-b189-000703ae4176 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jun 25 16:00:00.125348 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 20/38] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Jun 25 16:00:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:00:00.325057 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-8e5468a3-3385-4663-9b4a-09176a78f14b admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:00:00.331047 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.wsgi [None req-8e5468a3-3385-4663-9b4a-09176a78f14b admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 25 16:00:00.334360 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-8e5468a3-3385-4663-9b4a-09176a78f14b admin admin] Request method failure captured: Jun 25 16:00:00.334360 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 25 16:00:00.334360 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: Accept: application/json Jun 25 16:00:00.334360 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: Accept-Encoding: gzip, deflate Jun 25 16:00:00.334360 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: Connection: keep-alive Jun 25 16:00:00.334360 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: Content-Length: 0 Jun 25 16:00:00.334360 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: Host: 10.222.0.13 Jun 25 16:00:00.334360 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: Openstack-Api-Version: compute 2.90 Jun 25 16:00:00.334360 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: Openstack-System-Scope: None Jun 25 16:00:00.334360 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: User-Agent: python-novaclient Jun 25 16:00:00.334360 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Auth-Token: gAAAAABitzEAuEQN4qvfO4BcBrpKUXAtaKY8LLrRVKD_wlaoItXWysHRmkr8seKpEjw4b_jhai3jdPlYp7Mk_UnBvx5he4QE5pwSEa7fL6VjSb7S8--3O0hQ9pTZBA_Yp3ukeMQM58juptlIu6VcWJRMkF8YheqbkyBalIr7avHi3SFIfFKhCqU Jun 25 16:00:00.334360 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Domain-Id: None Jun 25 16:00:00.334360 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Domain-Name: None Jun 25 16:00:00.334360 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Identity-Status: Confirmed Jun 25 16:00:00.334360 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Is-Admin-Project: True Jun 25 16:00:00.334360 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Openstack-Nova-Api-Version: 2.90 Jun 25 16:00:00.334360 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Project-Domain-Id: default Jun 25 16:00:00.334360 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Project-Domain-Name: Default Jun 25 16:00:00.334360 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Project-Id: c8597e0eb76849bdadd0530f7e198ab0 Jun 25 16:00:00.334360 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Project-Name: admin Jun 25 16:00:00.334360 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Role: reader,admin,member Jun 25 16:00:00.334360 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Roles: reader,admin,member Jun 25 16:00:00.335928 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8597e0eb76849bdadd0530f7e198ab0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8597e0eb76849bdadd0530f7e198ab0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c8597e0eb76849bdadd0530f7e198ab0", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c8597e0eb76849bdadd0530f7e198ab0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:00:00.335928 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Tenant: admin Jun 25 16:00:00.335928 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Tenant-Id: c8597e0eb76849bdadd0530f7e198ab0 Jun 25 16:00:00.335928 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Tenant-Name: admin Jun 25 16:00:00.335928 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-User: admin Jun 25 16:00:00.335928 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-User-Domain-Id: default Jun 25 16:00:00.335928 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-User-Domain-Name: Default Jun 25 16:00:00.335928 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-User-Id: c132d4e24cfd4bd197338f840d4d9eb9 Jun 25 16:00:00.335928 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-User-Name: admin Jun 25 16:00:00.335928 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: method: > Jun 25 16:00:00.335928 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: exception: Flavor 42 could not be found. Jun 25 16:00:00.335928 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: action_args: {'id': '42'} Jun 25 16:00:00.335928 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:00:00.335928 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:00:00.337005 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 25 16:00:00.337005 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 25 16:00:00.337005 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 25 16:00:00.337005 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 25 16:00:00.337005 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 16:00:00.337005 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 16:00:00.337005 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 25 16:00:00.337005 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 25 16:00:00.337005 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 25 16:00:00.337005 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:00:00.337005 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 25 16:00:00.337005 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 25 16:00:00.337005 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 25 16:00:00.337005 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi Jun 25 16:00:00.337005 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:00:00.337005 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi Jun 25 16:00:00.337005 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:00:00.337005 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:00:00.337005 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:00:00.338390 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:00:00.338390 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:00:00.338390 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:00:00.338390 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:00:00.338390 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 25 16:00:00.338390 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:00:00.338390 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 25 16:00:00.338390 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi Jun 25 16:00:00.338390 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:00:00.338390 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi Jun 25 16:00:00.338390 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:00:00.338390 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:00:00.338390 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:00:00.338390 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:00:00.338390 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:00:00.338390 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 25 16:00:00.338390 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi Jun 25 16:00:00.338390 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-8e5468a3-3385-4663-9b4a-09176a78f14b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:00:00.339675 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-8e5468a3-3385-4663-9b4a-09176a78f14b admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.074157 Jun 25 16:00:00.339675 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 19/39] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Jun 25 16:00:00 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 25 16:00:00.345830 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-dfa05388-5d0c-4929-98ec-012b6d979b99 admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:00:00.348899 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG dbcounter [-] [103275] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:00:00.368976 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-dfa05388-5d0c-4929-98ec-012b6d979b99 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026846 Jun 25 16:00:00.369446 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 21/40] 10.222.0.13 () {60 vars in 1210 bytes} [Sat Jun 25 16:00:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:00:00.380322 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-fe29c568-9da7-4219-aebe-5d408d5cab64 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:00:00.403764 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-fe29c568-9da7-4219-aebe-5d408d5cab64 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027068 Jun 25 16:00:00.404302 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 20/41] 10.222.0.13 () {60 vars in 1210 bytes} [Sat Jun 25 16:00:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:00:00.415458 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-4b3c3897-9fd7-40e2-be43-96c68c422b3c admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:00:00.421927 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.wsgi [None req-4b3c3897-9fd7-40e2-be43-96c68c422b3c admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 25 16:00:00.425187 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-4b3c3897-9fd7-40e2-be43-96c68c422b3c admin admin] Request method failure captured: Jun 25 16:00:00.425187 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 25 16:00:00.425187 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: Accept: application/json Jun 25 16:00:00.425187 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: Accept-Encoding: gzip, deflate Jun 25 16:00:00.425187 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: Connection: keep-alive Jun 25 16:00:00.425187 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: Content-Length: 0 Jun 25 16:00:00.425187 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: Host: 10.222.0.13 Jun 25 16:00:00.425187 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: Openstack-Api-Version: compute 2.90 Jun 25 16:00:00.425187 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: Openstack-System-Scope: None Jun 25 16:00:00.425187 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: User-Agent: python-novaclient Jun 25 16:00:00.425187 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Auth-Token: gAAAAABitzEAuEQN4qvfO4BcBrpKUXAtaKY8LLrRVKD_wlaoItXWysHRmkr8seKpEjw4b_jhai3jdPlYp7Mk_UnBvx5he4QE5pwSEa7fL6VjSb7S8--3O0hQ9pTZBA_Yp3ukeMQM58juptlIu6VcWJRMkF8YheqbkyBalIr7avHi3SFIfFKhCqU Jun 25 16:00:00.425187 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Domain-Id: None Jun 25 16:00:00.425187 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Domain-Name: None Jun 25 16:00:00.425187 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Identity-Status: Confirmed Jun 25 16:00:00.425187 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Is-Admin-Project: True Jun 25 16:00:00.425187 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Openstack-Nova-Api-Version: 2.90 Jun 25 16:00:00.425187 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Project-Domain-Id: default Jun 25 16:00:00.425187 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Project-Domain-Name: Default Jun 25 16:00:00.425187 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Project-Id: c8597e0eb76849bdadd0530f7e198ab0 Jun 25 16:00:00.425187 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Project-Name: admin Jun 25 16:00:00.425187 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Role: reader,admin,member Jun 25 16:00:00.425187 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Roles: reader,admin,member Jun 25 16:00:00.426671 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8597e0eb76849bdadd0530f7e198ab0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8597e0eb76849bdadd0530f7e198ab0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c8597e0eb76849bdadd0530f7e198ab0", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c8597e0eb76849bdadd0530f7e198ab0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:00:00.426671 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Tenant: admin Jun 25 16:00:00.426671 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Tenant-Id: c8597e0eb76849bdadd0530f7e198ab0 Jun 25 16:00:00.426671 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Tenant-Name: admin Jun 25 16:00:00.426671 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-User: admin Jun 25 16:00:00.426671 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-User-Domain-Id: default Jun 25 16:00:00.426671 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-User-Domain-Name: Default Jun 25 16:00:00.426671 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-User-Id: c132d4e24cfd4bd197338f840d4d9eb9 Jun 25 16:00:00.426671 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-User-Name: admin Jun 25 16:00:00.426671 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: method: > Jun 25 16:00:00.426671 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: exception: Flavor 42 could not be found. Jun 25 16:00:00.426671 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: action_args: {'id': '42'} Jun 25 16:00:00.426671 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:00:00.426671 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:00:00.427520 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 25 16:00:00.427520 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 25 16:00:00.427520 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 25 16:00:00.427520 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 25 16:00:00.427520 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 16:00:00.427520 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 16:00:00.427520 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 25 16:00:00.427520 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 25 16:00:00.427520 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 25 16:00:00.427520 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:00:00.427520 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 25 16:00:00.427520 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 25 16:00:00.427520 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 25 16:00:00.427520 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Jun 25 16:00:00.427520 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:00:00.427520 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Jun 25 16:00:00.427520 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:00:00.427520 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:00:00.427520 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:00:00.428594 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:00:00.428594 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:00:00.428594 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:00:00.428594 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:00:00.428594 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 25 16:00:00.428594 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:00:00.428594 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 25 16:00:00.428594 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Jun 25 16:00:00.428594 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:00:00.428594 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Jun 25 16:00:00.428594 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:00:00.428594 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:00:00.428594 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:00:00.428594 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:00:00.428594 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:00:00.428594 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 25 16:00:00.428594 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Jun 25 16:00:00.428594 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-4b3c3897-9fd7-40e2-be43-96c68c422b3c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:00:00.429691 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-4b3c3897-9fd7-40e2-be43-96c68c422b3c admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015544 Jun 25 16:00:00.429691 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 22/42] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Jun 25 16:00:00 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 25 16:00:01.255059 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-fe29c568-9da7-4219-aebe-5d408d5cab64 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:00:01.256079 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-fe29c568-9da7-4219-aebe-5d408d5cab64 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Jun 25 16:00:01.256484 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 21/43] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Jun 25 16:00:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:00:01.466682 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-057ddee5-5aa8-4d23-9b63-24d740f56824 admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:00:01.473011 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.wsgi [None req-057ddee5-5aa8-4d23-9b63-24d740f56824 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 25 16:00:01.474564 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-057ddee5-5aa8-4d23-9b63-24d740f56824 admin admin] Request method failure captured: Jun 25 16:00:01.474564 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 25 16:00:01.474564 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: Accept: application/json Jun 25 16:00:01.474564 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: Accept-Encoding: gzip, deflate Jun 25 16:00:01.474564 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: Connection: keep-alive Jun 25 16:00:01.474564 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: Content-Length: 0 Jun 25 16:00:01.474564 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: Host: 10.222.0.13 Jun 25 16:00:01.474564 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: Openstack-Api-Version: compute 2.90 Jun 25 16:00:01.474564 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: Openstack-System-Scope: None Jun 25 16:00:01.474564 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: User-Agent: python-novaclient Jun 25 16:00:01.474564 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Auth-Token: gAAAAABitzEBVK4qRIpduFaC_A6aM4LYxodIxU05eZC6V_NgxIVGwrWZX4GTHBw49mSo77wstdWp1XpFYGTHEyQKFY6aI_DSrVVCtMkt1KQ5iRXarigZY5Jh61Hj1W7jvUyvGrxbeqQKH-Xr8eMF-lpOt-KBQ7H-KYIYk7M8vtS0bSdAjtRX2xM Jun 25 16:00:01.474564 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Domain-Id: None Jun 25 16:00:01.474564 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Domain-Name: None Jun 25 16:00:01.474564 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Identity-Status: Confirmed Jun 25 16:00:01.474564 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Is-Admin-Project: True Jun 25 16:00:01.474564 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Openstack-Nova-Api-Version: 2.90 Jun 25 16:00:01.474564 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Project-Domain-Id: default Jun 25 16:00:01.474564 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Project-Domain-Name: Default Jun 25 16:00:01.474564 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Project-Id: c8597e0eb76849bdadd0530f7e198ab0 Jun 25 16:00:01.474564 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Project-Name: admin Jun 25 16:00:01.474564 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Role: reader,admin,member Jun 25 16:00:01.474564 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Roles: reader,admin,member Jun 25 16:00:01.476050 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8597e0eb76849bdadd0530f7e198ab0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8597e0eb76849bdadd0530f7e198ab0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c8597e0eb76849bdadd0530f7e198ab0", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c8597e0eb76849bdadd0530f7e198ab0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:00:01.476050 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Tenant: admin Jun 25 16:00:01.476050 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Tenant-Id: c8597e0eb76849bdadd0530f7e198ab0 Jun 25 16:00:01.476050 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Tenant-Name: admin Jun 25 16:00:01.476050 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-User: admin Jun 25 16:00:01.476050 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-User-Domain-Id: default Jun 25 16:00:01.476050 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-User-Domain-Name: Default Jun 25 16:00:01.476050 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-User-Id: c132d4e24cfd4bd197338f840d4d9eb9 Jun 25 16:00:01.476050 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-User-Name: admin Jun 25 16:00:01.476050 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: method: > Jun 25 16:00:01.476050 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: exception: Flavor 84 could not be found. Jun 25 16:00:01.476050 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: action_args: {'id': '84'} Jun 25 16:00:01.476050 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:00:01.476050 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:00:01.477069 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 25 16:00:01.477069 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 25 16:00:01.477069 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 25 16:00:01.477069 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 25 16:00:01.477069 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 16:00:01.477069 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 16:00:01.477069 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 25 16:00:01.477069 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 25 16:00:01.477069 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 25 16:00:01.477069 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:00:01.477069 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 25 16:00:01.477069 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 25 16:00:01.477069 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 25 16:00:01.477069 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Jun 25 16:00:01.477069 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:00:01.477069 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Jun 25 16:00:01.477069 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:00:01.477069 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:00:01.477069 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:00:01.478475 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:00:01.478475 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:00:01.478475 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:00:01.478475 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:00:01.478475 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 25 16:00:01.478475 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:00:01.478475 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 25 16:00:01.478475 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Jun 25 16:00:01.478475 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:00:01.478475 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Jun 25 16:00:01.478475 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:00:01.478475 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:00:01.478475 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:00:01.478475 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:00:01.478475 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:00:01.478475 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 25 16:00:01.478475 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Jun 25 16:00:01.478475 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-057ddee5-5aa8-4d23-9b63-24d740f56824 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:00:01.479731 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-057ddee5-5aa8-4d23-9b63-24d740f56824 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.083689 Jun 25 16:00:01.479731 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 23/44] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Jun 25 16:00:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 25 16:00:01.486173 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-26155106-56e3-4e2d-8250-be1148962dce admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:00:01.500088 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-26155106-56e3-4e2d-8250-be1148962dce admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017484 Jun 25 16:00:01.500853 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 22/45] 10.222.0.13 () {60 vars in 1210 bytes} [Sat Jun 25 16:00:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 16:00:01.510274 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-9cd92685-74bb-4a64-ac12-a86d51732679 admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:00:01.524369 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-9cd92685-74bb-4a64-ac12-a86d51732679 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017583 Jun 25 16:00:01.524901 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 24/46] 10.222.0.13 () {60 vars in 1210 bytes} [Sat Jun 25 16:00:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 16:00:01.534154 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-951906a6-f48e-42ae-afb1-2551ad232338 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:00:01.539674 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.wsgi [None req-951906a6-f48e-42ae-afb1-2551ad232338 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 25 16:00:01.541225 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-951906a6-f48e-42ae-afb1-2551ad232338 admin admin] Request method failure captured: Jun 25 16:00:01.541225 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 25 16:00:01.541225 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: Accept: application/json Jun 25 16:00:01.541225 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: Accept-Encoding: gzip, deflate Jun 25 16:00:01.541225 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: Connection: keep-alive Jun 25 16:00:01.541225 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: Content-Length: 0 Jun 25 16:00:01.541225 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: Host: 10.222.0.13 Jun 25 16:00:01.541225 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: Openstack-Api-Version: compute 2.90 Jun 25 16:00:01.541225 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: Openstack-System-Scope: None Jun 25 16:00:01.541225 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: User-Agent: python-novaclient Jun 25 16:00:01.541225 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Auth-Token: gAAAAABitzEBVK4qRIpduFaC_A6aM4LYxodIxU05eZC6V_NgxIVGwrWZX4GTHBw49mSo77wstdWp1XpFYGTHEyQKFY6aI_DSrVVCtMkt1KQ5iRXarigZY5Jh61Hj1W7jvUyvGrxbeqQKH-Xr8eMF-lpOt-KBQ7H-KYIYk7M8vtS0bSdAjtRX2xM Jun 25 16:00:01.541225 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Domain-Id: None Jun 25 16:00:01.541225 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Domain-Name: None Jun 25 16:00:01.541225 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Identity-Status: Confirmed Jun 25 16:00:01.541225 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Is-Admin-Project: True Jun 25 16:00:01.541225 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Openstack-Nova-Api-Version: 2.90 Jun 25 16:00:01.541225 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Project-Domain-Id: default Jun 25 16:00:01.541225 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Project-Domain-Name: Default Jun 25 16:00:01.541225 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Project-Id: c8597e0eb76849bdadd0530f7e198ab0 Jun 25 16:00:01.541225 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Project-Name: admin Jun 25 16:00:01.541225 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Role: reader,admin,member Jun 25 16:00:01.541225 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Roles: reader,admin,member Jun 25 16:00:01.542685 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8597e0eb76849bdadd0530f7e198ab0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8597e0eb76849bdadd0530f7e198ab0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c8597e0eb76849bdadd0530f7e198ab0", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c8597e0eb76849bdadd0530f7e198ab0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:00:01.542685 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Tenant: admin Jun 25 16:00:01.542685 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Tenant-Id: c8597e0eb76849bdadd0530f7e198ab0 Jun 25 16:00:01.542685 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Tenant-Name: admin Jun 25 16:00:01.542685 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-User: admin Jun 25 16:00:01.542685 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-User-Domain-Id: default Jun 25 16:00:01.542685 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-User-Domain-Name: Default Jun 25 16:00:01.542685 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-User-Id: c132d4e24cfd4bd197338f840d4d9eb9 Jun 25 16:00:01.542685 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-User-Name: admin Jun 25 16:00:01.542685 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: method: > Jun 25 16:00:01.542685 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: exception: Flavor 84 could not be found. Jun 25 16:00:01.542685 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: action_args: {'id': '84'} Jun 25 16:00:01.542685 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:00:01.542685 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:00:01.543539 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 25 16:00:01.543539 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 25 16:00:01.543539 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 25 16:00:01.543539 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 25 16:00:01.543539 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 16:00:01.543539 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 16:00:01.543539 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 25 16:00:01.543539 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 25 16:00:01.543539 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 25 16:00:01.543539 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:00:01.543539 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 25 16:00:01.543539 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 25 16:00:01.543539 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 25 16:00:01.543539 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi Jun 25 16:00:01.543539 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:00:01.543539 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi Jun 25 16:00:01.543539 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:00:01.543539 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:00:01.543539 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:00:01.544622 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:00:01.544622 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:00:01.544622 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:00:01.544622 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:00:01.544622 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 25 16:00:01.544622 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:00:01.544622 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 25 16:00:01.544622 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi Jun 25 16:00:01.544622 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:00:01.544622 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi Jun 25 16:00:01.544622 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:00:01.544622 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:00:01.544622 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:00:01.544622 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:00:01.544622 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:00:01.544622 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 25 16:00:01.544622 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi Jun 25 16:00:01.544622 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-951906a6-f48e-42ae-afb1-2551ad232338 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:00:01.545618 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-951906a6-f48e-42ae-afb1-2551ad232338 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012082 Jun 25 16:00:01.545618 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 23/47] 10.222.0.13 () {60 vars in 1190 bytes} [Sat Jun 25 16:00:01 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 25 16:00:02.365087 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-9cd92685-74bb-4a64-ac12-a86d51732679 admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:00:02.366095 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-9cd92685-74bb-4a64-ac12-a86d51732679 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Jun 25 16:00:02.366637 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 25/48] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Jun 25 16:00:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:00:02.567187 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-0dd139ec-c4da-4e96-851a-cf27469a49e5 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:00:02.573091 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.wsgi [None req-0dd139ec-c4da-4e96-851a-cf27469a49e5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 25 16:00:02.574650 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-0dd139ec-c4da-4e96-851a-cf27469a49e5 admin admin] Request method failure captured: Jun 25 16:00:02.574650 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 25 16:00:02.574650 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: Accept: application/json Jun 25 16:00:02.574650 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: Accept-Encoding: gzip, deflate Jun 25 16:00:02.574650 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: Connection: keep-alive Jun 25 16:00:02.574650 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: Content-Length: 0 Jun 25 16:00:02.574650 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: Host: 10.222.0.13 Jun 25 16:00:02.574650 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: Openstack-Api-Version: compute 2.90 Jun 25 16:00:02.574650 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: Openstack-System-Scope: None Jun 25 16:00:02.574650 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: User-Agent: python-novaclient Jun 25 16:00:02.574650 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Auth-Token: gAAAAABitzEC-4-oddSJHxyJnzctg6EioSxvVX7VUYq8zWLfrxMlezZnXtwFiYCKGqkNNC4TV6ZII-8Rt6atMd-g9RPCwdyE22XrkyXJhfw-w7HM682lAO1zLJfdhew_NiSq2Y_b6YwLbVSNXSfxFlto5up40CBr5Ao3XYy3lR9QIptGIUGYgMk Jun 25 16:00:02.574650 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Domain-Id: None Jun 25 16:00:02.574650 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Domain-Name: None Jun 25 16:00:02.574650 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Identity-Status: Confirmed Jun 25 16:00:02.574650 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Is-Admin-Project: True Jun 25 16:00:02.574650 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Openstack-Nova-Api-Version: 2.90 Jun 25 16:00:02.574650 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Project-Domain-Id: default Jun 25 16:00:02.574650 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Project-Domain-Name: Default Jun 25 16:00:02.574650 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Project-Id: c8597e0eb76849bdadd0530f7e198ab0 Jun 25 16:00:02.574650 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Project-Name: admin Jun 25 16:00:02.574650 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Role: reader,admin,member Jun 25 16:00:02.574650 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Roles: reader,admin,member Jun 25 16:00:02.576187 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8597e0eb76849bdadd0530f7e198ab0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8597e0eb76849bdadd0530f7e198ab0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c8597e0eb76849bdadd0530f7e198ab0", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c8597e0eb76849bdadd0530f7e198ab0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:00:02.576187 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Tenant: admin Jun 25 16:00:02.576187 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Tenant-Id: c8597e0eb76849bdadd0530f7e198ab0 Jun 25 16:00:02.576187 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-Tenant-Name: admin Jun 25 16:00:02.576187 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-User: admin Jun 25 16:00:02.576187 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-User-Domain-Id: default Jun 25 16:00:02.576187 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-User-Domain-Name: Default Jun 25 16:00:02.576187 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-User-Id: c132d4e24cfd4bd197338f840d4d9eb9 Jun 25 16:00:02.576187 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: X-User-Name: admin Jun 25 16:00:02.576187 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: method: > Jun 25 16:00:02.576187 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: exception: Flavor 451 could not be found. Jun 25 16:00:02.576187 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: action_args: {'id': '451'} Jun 25 16:00:02.576187 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:00:02.576187 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:00:02.578094 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 25 16:00:02.578094 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 25 16:00:02.578094 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 25 16:00:02.578094 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 25 16:00:02.578094 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 16:00:02.578094 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 16:00:02.578094 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 25 16:00:02.578094 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 25 16:00:02.578094 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 25 16:00:02.578094 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:00:02.578094 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 25 16:00:02.578094 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 25 16:00:02.578094 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 25 16:00:02.578094 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi Jun 25 16:00:02.578094 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:00:02.578094 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi Jun 25 16:00:02.578094 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:00:02.578094 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:00:02.578094 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:00:02.579386 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:00:02.579386 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:00:02.579386 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:00:02.579386 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:00:02.579386 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 25 16:00:02.579386 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:00:02.579386 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 25 16:00:02.579386 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi Jun 25 16:00:02.579386 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:00:02.579386 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi Jun 25 16:00:02.579386 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:00:02.579386 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:00:02.579386 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:00:02.579386 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:00:02.579386 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:00:02.579386 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 25 16:00:02.579386 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: ERROR nova.api.openstack.wsgi Jun 25 16:00:02.579386 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-0dd139ec-c4da-4e96-851a-cf27469a49e5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:00:02.580671 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-0dd139ec-c4da-4e96-851a-cf27469a49e5 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.071769 Jun 25 16:00:02.580671 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 24/49] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Jun 25 16:00:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 25 16:00:02.586192 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-6ddc7c06-1e17-4440-b12b-f2fd79cdab14 admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:00:02.599845 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-6ddc7c06-1e17-4440-b12b-f2fd79cdab14 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017251 Jun 25 16:00:02.600353 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 26/50] 10.222.0.13 () {60 vars in 1210 bytes} [Sat Jun 25 16:00:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 16:00:02.609905 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-66860e1d-d984-4473-8c37-ddf543af6e60 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:00:02.629317 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-66860e1d-d984-4473-8c37-ddf543af6e60 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023100 Jun 25 16:00:02.629867 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 25/51] 10.222.0.13 () {60 vars in 1210 bytes} [Sat Jun 25 16:00:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 16:00:02.639518 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-325050a9-b2f5-4b25-a6c9-6502d3f4216c admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:00:02.646676 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.wsgi [None req-325050a9-b2f5-4b25-a6c9-6502d3f4216c admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 25 16:00:02.648191 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-325050a9-b2f5-4b25-a6c9-6502d3f4216c admin admin] Request method failure captured: Jun 25 16:00:02.648191 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 25 16:00:02.648191 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: Accept: application/json Jun 25 16:00:02.648191 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: Accept-Encoding: gzip, deflate Jun 25 16:00:02.648191 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: Connection: keep-alive Jun 25 16:00:02.648191 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: Content-Length: 0 Jun 25 16:00:02.648191 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: Host: 10.222.0.13 Jun 25 16:00:02.648191 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: Openstack-Api-Version: compute 2.90 Jun 25 16:00:02.648191 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: Openstack-System-Scope: None Jun 25 16:00:02.648191 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: User-Agent: python-novaclient Jun 25 16:00:02.648191 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Auth-Token: gAAAAABitzEC-4-oddSJHxyJnzctg6EioSxvVX7VUYq8zWLfrxMlezZnXtwFiYCKGqkNNC4TV6ZII-8Rt6atMd-g9RPCwdyE22XrkyXJhfw-w7HM682lAO1zLJfdhew_NiSq2Y_b6YwLbVSNXSfxFlto5up40CBr5Ao3XYy3lR9QIptGIUGYgMk Jun 25 16:00:02.648191 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Domain-Id: None Jun 25 16:00:02.648191 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Domain-Name: None Jun 25 16:00:02.648191 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Identity-Status: Confirmed Jun 25 16:00:02.648191 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Is-Admin-Project: True Jun 25 16:00:02.648191 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Openstack-Nova-Api-Version: 2.90 Jun 25 16:00:02.648191 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Project-Domain-Id: default Jun 25 16:00:02.648191 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Project-Domain-Name: Default Jun 25 16:00:02.648191 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Project-Id: c8597e0eb76849bdadd0530f7e198ab0 Jun 25 16:00:02.648191 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Project-Name: admin Jun 25 16:00:02.648191 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Role: reader,admin,member Jun 25 16:00:02.648191 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Roles: reader,admin,member Jun 25 16:00:02.649730 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8597e0eb76849bdadd0530f7e198ab0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c8597e0eb76849bdadd0530f7e198ab0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c8597e0eb76849bdadd0530f7e198ab0", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c8597e0eb76849bdadd0530f7e198ab0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:00:02.649730 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Tenant: admin Jun 25 16:00:02.649730 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Tenant-Id: c8597e0eb76849bdadd0530f7e198ab0 Jun 25 16:00:02.649730 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-Tenant-Name: admin Jun 25 16:00:02.649730 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-User: admin Jun 25 16:00:02.649730 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-User-Domain-Id: default Jun 25 16:00:02.649730 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-User-Domain-Name: Default Jun 25 16:00:02.649730 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-User-Id: c132d4e24cfd4bd197338f840d4d9eb9 Jun 25 16:00:02.649730 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: X-User-Name: admin Jun 25 16:00:02.649730 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: method: > Jun 25 16:00:02.649730 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: exception: Flavor 451 could not be found. Jun 25 16:00:02.649730 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: action_args: {'id': '451'} Jun 25 16:00:02.649730 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:00:02.649730 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:00:02.650662 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 25 16:00:02.650662 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 25 16:00:02.650662 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 25 16:00:02.650662 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 25 16:00:02.650662 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 16:00:02.650662 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 16:00:02.650662 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 25 16:00:02.650662 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 25 16:00:02.650662 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 25 16:00:02.650662 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:00:02.650662 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 25 16:00:02.650662 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 25 16:00:02.650662 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 25 16:00:02.650662 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Jun 25 16:00:02.650662 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:00:02.650662 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Jun 25 16:00:02.650662 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:00:02.650662 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:00:02.650662 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:00:02.652144 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:00:02.652144 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:00:02.652144 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:00:02.652144 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:00:02.652144 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 25 16:00:02.652144 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:00:02.652144 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 25 16:00:02.652144 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Jun 25 16:00:02.652144 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:00:02.652144 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Jun 25 16:00:02.652144 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:00:02.652144 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:00:02.652144 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:00:02.652144 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:00:02.652144 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:00:02.652144 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 25 16:00:02.652144 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: ERROR nova.api.openstack.wsgi Jun 25 16:00:02.652144 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-325050a9-b2f5-4b25-a6c9-6502d3f4216c admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:00:02.654114 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-325050a9-b2f5-4b25-a6c9-6502d3f4216c admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013788 Jun 25 16:00:02.654114 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 27/52] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Jun 25 16:00:02 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 25 16:00:03.495836 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-66860e1d-d984-4473-8c37-ddf543af6e60 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:00:03.497472 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-66860e1d-d984-4473-8c37-ddf543af6e60 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002216 Jun 25 16:00:03.498019 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 26/53] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Jun 25 16:00:03 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:00:03.701806 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-78e5bd3e-774b-495b-bd8b-ae8317aebe7a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:00:03.723987 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-78e5bd3e-774b-495b-bd8b-ae8317aebe7a admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.088853 Jun 25 16:00:03.724586 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 28/54] 10.222.0.13 () {64 vars in 1235 bytes} [Sat Jun 25 16:00:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 16:00:04.549338 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-66860e1d-d984-4473-8c37-ddf543af6e60 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:00:04.550340 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-66860e1d-d984-4473-8c37-ddf543af6e60 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jun 25 16:00:04.550728 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 27/55] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Jun 25 16:00:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:00:04.757288 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-9f5fdbd8-643d-45f0-ab89-e2364912aa89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:00:04.777947 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-9f5fdbd8-643d-45f0-ab89-e2364912aa89 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.087271 Jun 25 16:00:04.778493 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 29/56] 10.222.0.13 () {64 vars in 1235 bytes} [Sat Jun 25 16:00:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 16:00:05.622169 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-66860e1d-d984-4473-8c37-ddf543af6e60 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:00:05.623456 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-66860e1d-d984-4473-8c37-ddf543af6e60 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001735 Jun 25 16:00:05.623979 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 28/57] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Jun 25 16:00:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:00:05.826087 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-7abdf6f9-5946-49ef-aeae-26aad1e56f61 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:00:05.857917 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-7abdf6f9-5946-49ef-aeae-26aad1e56f61 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.096816 Jun 25 16:00:05.858467 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 30/58] 10.222.0.13 () {64 vars in 1235 bytes} [Sat Jun 25 16:00:05 2022] POST /compute/v2.1/flavors => generated 407 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 16:00:06.682669 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-66860e1d-d984-4473-8c37-ddf543af6e60 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:00:06.683688 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-66860e1d-d984-4473-8c37-ddf543af6e60 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Jun 25 16:00:06.684082 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 29/59] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Jun 25 16:00:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:00:06.880671 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-aafbac55-7262-4b8d-87e7-dd74b6ca151f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:00:06.900860 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-aafbac55-7262-4b8d-87e7-dd74b6ca151f admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.082630 Jun 25 16:00:06.901332 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 31/60] 10.222.0.13 () {64 vars in 1235 bytes} [Sat Jun 25 16:00:06 2022] POST /compute/v2.1/flavors => generated 409 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 16:00:07.731556 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-66860e1d-d984-4473-8c37-ddf543af6e60 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:00:07.732623 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-66860e1d-d984-4473-8c37-ddf543af6e60 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jun 25 16:00:07.733013 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 30/61] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Jun 25 16:00:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:00:07.923254 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-feba7d81-f8d9-4dfe-9bc6-f5fbff5aad01 admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:00:07.942311 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-feba7d81-f8d9-4dfe-9bc6-f5fbff5aad01 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.074941 Jun 25 16:00:07.942761 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 32/62] 10.222.0.13 () {60 vars in 1202 bytes} [Sat Jun 25 16:00:07 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:00:54.611766 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-66860e1d-d984-4473-8c37-ddf543af6e60 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:00:54.612802 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-66860e1d-d984-4473-8c37-ddf543af6e60 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jun 25 16:00:54.613235 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 31/63] 10.222.0.13 () {54 vars in 930 bytes} [Sat Jun 25 16:00:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:00:54.623631 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG dbcounter [-] [103275] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:00:54.672566 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-ff6c3d39-e273-4df2-8a06-a6b60f6074b8 admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:00:54.691259 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-ff6c3d39-e273-4df2-8a06-a6b60f6074b8 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072059 Jun 25 16:00:54.691787 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 33/64] 10.222.0.13 () {60 vars in 1291 bytes} [Sat Jun 25 16:00:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:00:54.717353 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-81ea415a-1f35-4bb4-9009-1271fbe596de admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:00:54.722619 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG dbcounter [-] [103276] Writing DB stats nova_api:SELECT=14 {{(pid=103276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:00:54.732070 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-81ea415a-1f35-4bb4-9009-1271fbe596de admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.020381 Jun 25 16:00:54.732854 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 32/65] 10.222.0.13 () {60 vars in 1282 bytes} [Sat Jun 25 16:00:54 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:00:54.744248 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-0b484ab7-0710-49f4-aea0-5b36a9d7ae5b admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:00:54.751958 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-0b484ab7-0710-49f4-aea0-5b36a9d7ae5b admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011289 Jun 25 16:00:54.752453 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 34/66] 10.222.0.13 () {60 vars in 1285 bytes} [Sat Jun 25 16:00:54 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:00:54.763679 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-0c5b0c96-9c21-414a-860a-401ffd95d124 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:00:54.772055 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-0c5b0c96-9c21-414a-860a-401ffd95d124 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011940 Jun 25 16:00:54.772580 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 33/67] 10.222.0.13 () {60 vars in 1285 bytes} [Sat Jun 25 16:00:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:00:54.784303 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-d1867ad4-6d95-486c-a4a8-978e9850aca2 admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:00:54.792347 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-d1867ad4-6d95-486c-a4a8-978e9850aca2 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011773 Jun 25 16:00:54.792856 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 35/68] 10.222.0.13 () {60 vars in 1282 bytes} [Sat Jun 25 16:00:54 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:04:05.092134 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-0c5b0c96-9c21-414a-860a-401ffd95d124 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:04:05.093197 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-0c5b0c96-9c21-414a-860a-401ffd95d124 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Jun 25 16:04:05.093563 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 34/69] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Jun 25 16:04:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:04:05.234193 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG dbcounter [-] [103275] Writing DB stats nova_api:SELECT=6 {{(pid=103275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:04:05.357467 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-0c6a8fdb-ddb4-474c-b167-a13a24e6919e admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:04:05.358607 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 16:04:05.358607 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: warnings.warn(msg) Jun 25 16:04:05.359769 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-0c6a8fdb-ddb4-474c-b167-a13a24e6919e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:04:05.360211 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-0c6a8fdb-ddb4-474c-b167-a13a24e6919e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:04:05.360996 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-0c6a8fdb-ddb4-474c-b167-a13a24e6919e admin admin] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:04:05.361439 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-0c6a8fdb-ddb4-474c-b167-a13a24e6919e admin admin] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:04:05.396536 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-0c6a8fdb-ddb4-474c-b167-a13a24e6919e admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.163728 Jun 25 16:04:05.397089 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 36/70] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Jun 25 16:04:05 2022] GET /compute/v2.1/os-services => generated 791 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 16:04:06.221169 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-0c5b0c96-9c21-414a-860a-401ffd95d124 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:04:06.222543 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-0c5b0c96-9c21-414a-860a-401ffd95d124 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001903 Jun 25 16:04:06.223326 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 35/71] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Jun 25 16:04:06 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:04:06.434139 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-40630b63-c3cc-4eb7-9a60-987ddd444696 admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:04:06.435288 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 16:04:06.435288 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: warnings.warn(msg) Jun 25 16:04:06.436487 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-40630b63-c3cc-4eb7-9a60-987ddd444696 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:04:06.436924 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-40630b63-c3cc-4eb7-9a60-987ddd444696 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:04:06.437687 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-40630b63-c3cc-4eb7-9a60-987ddd444696 admin admin] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:04:06.438107 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-40630b63-c3cc-4eb7-9a60-987ddd444696 admin admin] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:04:06.457520 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-40630b63-c3cc-4eb7-9a60-987ddd444696 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.080494 Jun 25 16:04:06.458067 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 37/72] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Jun 25 16:04:06 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 16:04:17.746627 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-0c5b0c96-9c21-414a-860a-401ffd95d124 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:04:17.748344 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-0c5b0c96-9c21-414a-860a-401ffd95d124 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002801 Jun 25 16:04:17.748783 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 36/73] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Jun 25 16:04:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:04:17.891693 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG dbcounter [-] [103275] Writing DB stats nova_cell0:SELECT=4 {{(pid=103275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:04:17.892426 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG dbcounter [-] [103275] Writing DB stats nova_cell1:SELECT=4 {{(pid=103275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:04:17.893251 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG dbcounter [-] [103275] Writing DB stats nova_api:SELECT=8 {{(pid=103275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:04:17.952296 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-fc2528e8-e313-4a0e-ba87-54e08c54e6bb admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:04:17.954016 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 16:04:17.954016 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: warnings.warn(msg) Jun 25 16:04:17.955768 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-fc2528e8-e313-4a0e-ba87-54e08c54e6bb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:04:17.956213 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-fc2528e8-e313-4a0e-ba87-54e08c54e6bb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:04:17.957231 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-fc2528e8-e313-4a0e-ba87-54e08c54e6bb admin admin] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:04:17.957774 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-fc2528e8-e313-4a0e-ba87-54e08c54e6bb admin admin] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:04:17.984249 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-fc2528e8-e313-4a0e-ba87-54e08c54e6bb admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.097294 Jun 25 16:04:17.984811 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 38/74] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Jun 25 16:04:17 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:04:18.807274 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: DEBUG nova.api.openstack.wsgi [None req-0c5b0c96-9c21-414a-860a-401ffd95d124 admin admin] Calling method '>' {{(pid=103276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:04:18.808353 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: INFO nova.api.openstack.requestlog [None req-0c5b0c96-9c21-414a-860a-401ffd95d124 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001542 Jun 25 16:04:18.808786 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: [pid: 103276|app: 0|req: 37/75] 10.222.0.13 () {56 vars in 1074 bytes} [Sat Jun 25 16:04:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:04:19.009802 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG nova.api.openstack.wsgi [None req-f62bdf28-b93b-42a8-8e1b-05d51d1eef91 admin admin] Calling method '>' {{(pid=103275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:04:19.011056 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 25 16:04:19.011056 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: warnings.warn(msg) Jun 25 16:04:19.012232 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-f62bdf28-b93b-42a8-8e1b-05d51d1eef91 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:04:19.012709 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-f62bdf28-b93b-42a8-8e1b-05d51d1eef91 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:04:19.013555 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-f62bdf28-b93b-42a8-8e1b-05d51d1eef91 admin admin] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:04:19.013915 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: DEBUG oslo_concurrency.lockutils [None req-f62bdf28-b93b-42a8-8e1b-05d51d1eef91 admin admin] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:04:19.035577 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: INFO nova.api.openstack.requestlog [None req-f62bdf28-b93b-42a8-8e1b-05d51d1eef91 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.091002 Jun 25 16:04:19.036117 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: [pid: 103275|app: 0|req: 39/76] 10.222.0.13 () {60 vars in 1193 bytes} [Sat Jun 25 16:04:18 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:05:13.262869 dv-cinder-847620-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 25 16:05:13.263453 dv-cinder-847620-2-iscsi devstack@n-api.service[103274]: Sat Jun 25 16:05:13 2022 - graceful shutdown triggered... Jun 25 16:05:13.263901 dv-cinder-847620-2-iscsi devstack@n-api.service[103276]: Gracefully killing worker 2 (pid: 103276)... Jun 25 16:05:13.264250 dv-cinder-847620-2-iscsi devstack@n-api.service[103275]: Gracefully killing worker 1 (pid: 103275)... Jun 25 16:05:14.264728 dv-cinder-847620-2-iscsi devstack@n-api.service[103274]: worker 1 buried after 1 seconds Jun 25 16:05:14.264728 dv-cinder-847620-2-iscsi devstack@n-api.service[103274]: worker 2 buried after 1 seconds Jun 25 16:05:14.264728 dv-cinder-847620-2-iscsi devstack@n-api.service[103274]: goodbye to uWSGI. Jun 25 16:05:14.267564 dv-cinder-847620-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 25 16:05:14.268497 dv-cinder-847620-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 25 16:05:14.273048 dv-cinder-847620-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 25 16:05:14.288236 dv-cinder-847620-2-iscsi devstack@n-api.service[117774]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 25 16:05:14.290250 dv-cinder-847620-2-iscsi devstack@n-api.service[117774]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Jun 25 16:05:14 2022] *** Jun 25 16:05:14.290250 dv-cinder-847620-2-iscsi devstack@n-api.service[117774]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 25 16:05:14.290250 dv-cinder-847620-2-iscsi devstack@n-api.service[117774]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 25 16:05:14.290250 dv-cinder-847620-2-iscsi devstack@n-api.service[117774]: nodename: dv-cinder-847620-2-iscsi Jun 25 16:05:14.290250 dv-cinder-847620-2-iscsi devstack@n-api.service[117774]: machine: x86_64 Jun 25 16:05:14.290250 dv-cinder-847620-2-iscsi devstack@n-api.service[117774]: clock source: unix Jun 25 16:05:14.290250 dv-cinder-847620-2-iscsi devstack@n-api.service[117774]: pcre jit disabled Jun 25 16:05:14.290250 dv-cinder-847620-2-iscsi devstack@n-api.service[117774]: detected number of CPU cores: 4 Jun 25 16:05:14.290250 dv-cinder-847620-2-iscsi devstack@n-api.service[117774]: current working directory: / Jun 25 16:05:14.290250 dv-cinder-847620-2-iscsi devstack@n-api.service[117774]: detected binary path: /usr/bin/uwsgi-core Jun 25 16:05:14.290250 dv-cinder-847620-2-iscsi devstack@n-api.service[117774]: your processes number limit is 47680 Jun 25 16:05:14.290250 dv-cinder-847620-2-iscsi devstack@n-api.service[117774]: your memory page size is 4096 bytes Jun 25 16:05:14.290250 dv-cinder-847620-2-iscsi devstack@n-api.service[117774]: detected max file descriptor number: 2048 Jun 25 16:05:14.290250 dv-cinder-847620-2-iscsi devstack@n-api.service[117774]: lock engine: pthread robust mutexes Jun 25 16:05:14.291284 dv-cinder-847620-2-iscsi devstack@n-api.service[117774]: thunder lock: enabled Jun 25 16:05:14.291284 dv-cinder-847620-2-iscsi devstack@n-api.service[117774]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 25 16:05:14.291284 dv-cinder-847620-2-iscsi devstack@n-api.service[117774]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 25 16:05:14.338902 dv-cinder-847620-2-iscsi devstack@n-api.service[117774]: Python main interpreter initialized at 0x55a668eea9c0 Jun 25 16:05:14.338902 dv-cinder-847620-2-iscsi devstack@n-api.service[117774]: python threads support enabled Jun 25 16:05:14.338902 dv-cinder-847620-2-iscsi devstack@n-api.service[117774]: your server socket listen backlog is limited to 100 connections Jun 25 16:05:14.338902 dv-cinder-847620-2-iscsi devstack@n-api.service[117774]: your mercy for graceful operations on workers is 90 seconds Jun 25 16:05:14.339354 dv-cinder-847620-2-iscsi devstack@n-api.service[117774]: mapped 403077 bytes (393 KB) for 2 cores Jun 25 16:05:14.339354 dv-cinder-847620-2-iscsi devstack@n-api.service[117774]: *** Operational MODE: preforking *** Jun 25 16:05:14.339624 dv-cinder-847620-2-iscsi devstack@n-api.service[117774]: *** uWSGI is running in multiple interpreter mode *** Jun 25 16:05:14.339624 dv-cinder-847620-2-iscsi devstack@n-api.service[117774]: spawned uWSGI master process (pid: 117774) Jun 25 16:05:14.339860 dv-cinder-847620-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 25 16:05:14.340762 dv-cinder-847620-2-iscsi devstack@n-api.service[117774]: spawned uWSGI worker 1 (pid: 117793, cores: 1) Jun 25 16:05:14.340762 dv-cinder-847620-2-iscsi devstack@n-api.service[117774]: spawned uWSGI worker 2 (pid: 117794, cores: 1) Jun 25 16:05:14.343007 dv-cinder-847620-2-iscsi devstack@n-api.service[117774]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 25 16:05:14.989070 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 25 16:05:14.989736 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 25 16:05:16.170376 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 25 16:05:16.170376 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: from cryptography.utils import int_from_bytes Jun 25 16:05:16.171058 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 25 16:05:16.171058 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: from cryptography.utils import int_from_bytes Jun 25 16:05:16.186881 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 25 16:05:16.186881 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: from cryptography.utils import int_from_bytes Jun 25 16:05:16.187481 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 25 16:05:16.187481 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: from cryptography.utils import int_from_bytes Jun 25 16:05:18.526347 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 25 16:05:18.526980 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 25 16:05:18.527291 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 25 16:05:18.527491 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 25 16:05:18.527749 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 25 16:05:18.528170 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.528527 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.528848 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.529159 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.529470 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.529813 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.530111 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.530446 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.530765 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.531016 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.531331 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.531665 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847620-2-iscsi {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.531978 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.532291 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.532668 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.532977 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.533269 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.533607 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.533902 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.534424 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.535809 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.535809 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.535809 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.536122 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.536475 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.536783 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.537131 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.537442 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.537777 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.538086 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.538496 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847620-2-iscsi {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.538820 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.539145 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.539466 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.539874 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.540184 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.540727 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.541195 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.541560 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.541876 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.542202 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.542509 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.542855 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.543163 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.543467 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.543760 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.544072 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.544400 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.544743 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.545047 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.545296 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.545601 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.545900 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.546234 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.546556 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.546794 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.547063 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.547369 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.547666 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.548004 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.548323 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.548669 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.548955 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.549262 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.549566 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.549871 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.550188 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.550493 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.550805 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.551128 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.551434 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.551751 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.552159 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.552444 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.552741 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.553083 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.553431 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.553740 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.554058 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.554384 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.554688 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.554992 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.555300 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.555617 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.555988 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.556291 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.556570 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.556872 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.557185 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.557507 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.557810 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.558117 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.558426 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.558724 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.559030 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.559339 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.559645 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.559950 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.560255 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.560584 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.560888 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.561192 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.561493 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.561809 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.562128 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.562435 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.562743 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.563049 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.563356 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.563848 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.564161 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.564497 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.564835 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.565137 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.565440 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.565684 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 25 16:05:18.566191 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.566343 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 25 16:05:18.566572 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.566572 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.566854 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 25 16:05:18.567003 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.567166 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 25 16:05:18.567308 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.567462 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 25 16:05:18.567634 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.567634 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.567924 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.568072 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.568245 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.568396 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.568600 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.568747 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.568905 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.569057 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.569217 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.569359 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.569506 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.569673 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.569816 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.569964 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.570125 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.570268 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.570416 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.570564 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.570734 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.570877 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.571032 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.571184 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.571333 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847620-2-iscsi {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.571530 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.571714 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.571866 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.572018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.572169 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.572316 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.572486 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.572633 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.572811 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.572964 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.573123 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.573265 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.573265 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.573548 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.573548 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.573834 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.574005 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.574151 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.574299 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.574454 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.574603 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.574762 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.574922 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.575844 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.576035 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.576200 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.576343 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.576517 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.576661 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.576812 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.576954 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.577104 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.577272 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.577417 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.577578 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.577732 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.578002 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.578161 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847620-2-iscsi {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.578320 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.578473 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.578614 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.578768 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.578916 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.579056 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.579196 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.579196 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.579490 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.579646 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.579788 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.579927 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.580066 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.580205 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.580345 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.580546 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.580690 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.580690 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.580964 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.581114 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.581271 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.581425 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.581619 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.581771 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.581920 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.582061 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.582219 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.582360 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.582501 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.582648 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.582789 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.582937 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.583098 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.583240 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.583398 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.583547 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.583695 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.583852 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.584000 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.584147 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.584288 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.584454 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.584611 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.584766 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.584908 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.585048 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.585332 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.586122 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.586285 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.586441 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.586593 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.586737 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.586888 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.587037 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.587188 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.587337 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.587480 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.587628 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.587789 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.587937 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.588097 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.588246 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.588387 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.588605 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.588757 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.588899 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.589048 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.589204 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.589204 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.589487 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.589628 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.589787 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.589944 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.590092 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.590240 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.590381 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.590519 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.590667 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.590816 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.590956 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.591102 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.591249 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.591397 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.591561 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.591710 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.591859 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.592008 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.592156 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.592304 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.592481 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.592635 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.592783 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.592931 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.593080 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.593228 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.593378 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.593378 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.593666 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.593807 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.593955 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.594110 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.594251 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.594390 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.594530 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.594679 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.594820 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.594980 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.595123 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.595288 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.595515 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.595515 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.596463 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.596958 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.597132 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.597289 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.597441 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.597592 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.597739 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.597903 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.598055 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.598211 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.598367 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.598528 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.598677 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.598819 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.598974 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.599125 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.599267 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.599408 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.599550 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.599692 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.599846 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.599989 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.600129 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.600289 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.600465 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.600628 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.600777 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.600929 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.601077 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.601225 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.601367 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.601520 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.601669 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.601821 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.601969 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.602119 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.602277 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.602428 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.602581 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.602733 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.602986 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.603129 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.603278 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.603462 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.603742 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.603742 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.604021 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.604162 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.604314 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.604516 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.604671 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.604821 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.604977 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.605118 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.605266 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.605414 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.605645 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.606406 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.606566 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.606720 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.606720 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.607006 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.607159 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.607311 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.607460 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.607610 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.607759 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.607901 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.608050 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.608204 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.608353 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.608539 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.608685 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.608833 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.608981 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.609150 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.609293 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.609433 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.609573 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.609722 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.609879 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.610021 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.610161 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.610309 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.610450 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.610597 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.610750 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.610911 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.611053 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.611193 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.611340 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.611481 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.611636 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.611786 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.611928 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.612075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.612224 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.612364 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.612586 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.612731 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.612891 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.613041 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 25 16:05:18.613182 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.613331 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.613472 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.613621 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.613763 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.613905 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.614046 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.614204 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.614353 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.614501 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.614651 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.614803 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.614944 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.615095 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.615243 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.615384 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.615523 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.615687 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.615903 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.616656 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.616809 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.616960 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.617110 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.617275 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.617427 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.617577 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.617726 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.617867 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.618024 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.618169 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.618324 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.618541 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.618685 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.618825 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.618965 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.619105 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.619418 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.619581 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.619732 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.619880 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.620021 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.620162 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.620317 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.620477 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.620623 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.620765 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.620904 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.621061 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.621203 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.622002 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.622165 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.622310 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.622452 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.622706 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.622861 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.623011 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.623152 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.623293 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.623443 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.623597 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.623797 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.623944 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.624097 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.624247 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.624397 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.624680 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.624848 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.629385 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.629594 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.629764 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.629928 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.630085 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.630237 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.630399 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.630679 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.630679 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.631005 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.631161 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.631304 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.631304 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.631582 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.631582 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.631869 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.632019 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.632167 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.632316 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.632486 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.632646 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.632799 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.632940 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.633088 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.633235 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.633376 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.633530 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.633672 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.633813 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.633953 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.634162 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.634321 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.634657 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.634819 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.634973 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.635120 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.635265 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.635385 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.635509 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.635630 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.635740 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.635859 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.635997 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.636124 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.636262 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.636444 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.636444 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.636723 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.636858 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.637001 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.637137 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.637137 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.637137 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.637137 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.637137 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.637137 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.637137 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.637137 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.638171 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.638171 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.638171 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.638171 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.638171 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.638171 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.638171 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.638171 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.639983 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.639983 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.639983 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.639983 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.639983 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.639983 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.641227 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.641404 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.641596 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.641750 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.641892 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.641892 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.642182 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.642326 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.642475 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.642617 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.642617 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.642891 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.643053 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.643053 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.643323 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.643462 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.643462 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.643745 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.643895 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.644037 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.644183 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.644326 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.644557 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.644720 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.644865 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.644977 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.645094 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.645204 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.645322 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.645447 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.645447 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.645447 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.645447 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.645841 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.645950 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.646066 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.646264 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.646410 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.646569 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.646722 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.646871 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.647026 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.647168 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.647315 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.647541 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.647775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.647933 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.648091 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.648234 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.648381 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.648569 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.648720 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.648720 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.649462 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.649871 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.650108 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.650273 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.650417 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.650741 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.650893 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.651036 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.651178 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.651328 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.651490 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.651640 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.651784 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.651926 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.652077 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.652219 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.652367 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.652581 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.652734 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.652890 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.653048 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.653189 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.653189 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.653475 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.653624 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.653770 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.653946 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.654099 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.654248 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.654389 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.654538 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.654686 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.654841 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.655051 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.655196 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.655346 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.655506 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.655506 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.655794 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.655937 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.655937 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.656220 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.656360 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.656579 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.656754 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.656907 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.657056 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.657205 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.657358 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.657583 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.657727 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.657877 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.658030 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.658175 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.658293 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.658419 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.658546 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.658660 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.658776 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.658776 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.659008 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.659643 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.659994 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.660384 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.660575 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.660735 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.660735 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.661024 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.661167 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.661315 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.661457 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.661597 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.661760 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.661916 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.662076 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.662227 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.662368 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.662368 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.662654 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.662802 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.662951 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.663093 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.663093 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.663379 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.663530 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.663683 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.663832 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.663832 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.664112 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.664267 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.664434 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.664593 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.664593 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.665034 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.665195 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.665405 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.665551 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.665879 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.666042 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.666042 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.666337 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.666489 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.666630 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.666771 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.666771 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.667055 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.667205 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.667347 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.667488 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.667488 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.667488 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.667882 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.668042 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.668042 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.668322 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.668481 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.668636 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.668792 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.669015 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.669162 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.669327 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.670033 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.670284 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.670624 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.670786 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.670942 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.671093 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.671235 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.671383 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.671538 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.671690 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.671839 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.671839 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.672108 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.672248 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.672248 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.672248 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.672721 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.672877 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.673035 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.673177 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.673332 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.673482 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.673624 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.673774 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.673923 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.674064 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.674214 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.674357 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.674498 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.674647 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.674808 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.674958 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.675101 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.675250 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.675391 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.675532 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.675673 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.675824 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.675966 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.676113 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.676262 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.676429 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.676587 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.676741 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.676893 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.677063 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.677321 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.677497 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.677649 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.677805 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.677955 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.678111 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.678111 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.678412 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.678575 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.678743 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.678899 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.679049 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.679197 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.679353 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.679527 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.680028 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.680269 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.680575 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.680906 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.681076 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.681237 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.681388 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.681548 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.681697 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.681844 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.682000 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.682164 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.682321 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.682469 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.682625 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.682774 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.682936 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.683092 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.683092 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.683092 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.683092 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.683677 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.683875 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.684036 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.684195 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.684344 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.684525 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.684684 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.684843 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.685001 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.685159 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.685318 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.685479 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.685479 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.685771 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.685927 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.686082 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.686238 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.686394 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.686553 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.686715 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.686863 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.687010 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.687166 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.687323 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.687482 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.687639 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.687795 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.687943 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.688111 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.688260 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.688456 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.688622 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.688782 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.688948 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.689104 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.689268 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.689419 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.689584 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.689757 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.690344 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.690583 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.690975 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.691133 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.691283 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.691440 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.691612 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.691762 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.691919 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.692083 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.692232 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.693037 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.693195 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.693352 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.693512 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.693662 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.693811 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.693959 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.694343 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.694513 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.694677 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.694835 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.695002 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.695151 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.695300 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.695300 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.695641 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.695792 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.695948 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.696106 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.696255 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.696431 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.696692 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.696692 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.696998 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.697159 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.697317 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.697317 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.697610 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.697759 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.697916 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.698065 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.698221 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.698445 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.698597 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.698759 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.698912 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.699079 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.699235 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.699393 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.699551 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.699701 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.699855 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.700024 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.700627 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.700627 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.700627 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.701436 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.701436 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.701735 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.701906 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.702057 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.702057 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.702337 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.702337 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.702636 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.702800 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.702958 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.703107 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.703262 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.703411 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.703566 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.703735 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.703884 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.704041 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.704191 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.704340 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.704526 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.704686 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.704835 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.704983 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.705132 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.705288 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.705446 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.705446 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.705992 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.706162 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.706925 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.707029 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.707029 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.707186 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.707260 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.707333 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.707412 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.707485 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.707570 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.707645 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.707716 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.707716 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.707855 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.707942 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.708016 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.708099 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.708179 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.708252 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.708252 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.708393 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.708517 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.708601 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.708690 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.708690 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.708847 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.708944 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.709031 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.709117 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.709204 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.709288 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.709288 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.709456 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.709543 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.709627 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.709711 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.709795 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.709887 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.709981 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.710074 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.710169 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.710259 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.710334 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.710414 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.710488 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.710566 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.710646 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.710718 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.710789 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.710871 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.710944 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.711014 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.711085 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.711164 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.711286 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.711422 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.711601 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.711742 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.711961 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.712071 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.712505 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.712656 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.712983 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.713083 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.713301 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.713393 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.713615 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.713722 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.713929 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.714020 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.714283 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.714376 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.714597 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.714690 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.714908 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.714999 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.715214 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.715314 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.715518 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.715610 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.715847 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.715945 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.716156 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.716261 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.716505 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.716614 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.716828 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.716927 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.717137 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.717279 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.717444 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.717590 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.717751 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.717917 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.718065 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.718156 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.718377 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.718468 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.718687 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.718789 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.719014 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.719114 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.719331 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.719438 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.719648 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.719753 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.719956 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.720047 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.720284 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.720402 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.720710 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.720818 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.720939 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.721056 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.721252 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.721354 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.721568 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.721706 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.721880 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.721979 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.722195 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.722285 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.722509 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.722600 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.722816 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.722917 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.723134 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.723224 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.723447 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.723538 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.723761 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.723858 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.724079 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.724338 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.724472 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.724701 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.724812 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.725021 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.725112 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.725330 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.725423 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.725642 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.725762 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.725958 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.726227 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.726334 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.726573 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.726663 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.726889 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.727027 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.727201 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.727422 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.727522 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.727893 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.727990 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.728223 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.728547 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.728727 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.728906 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.729122 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.729213 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.729521 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.729627 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.729836 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.730049 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.730149 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.730462 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.730560 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.730995 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.731340 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.732193 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.732290 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.732364 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.732480 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.732559 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.732639 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.732711 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.732711 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.732838 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.732918 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.732998 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.733202 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.733318 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.733529 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.733646 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.733845 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.733930 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.734156 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.734245 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.734471 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.734559 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.734786 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.734868 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.735115 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.735199 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.736447 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.736605 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.736729 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.736822 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.736902 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.736999 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.737107 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.737212 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.737212 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.737212 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.737510 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.737780 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.737939 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.738128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.738270 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.738473 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.738608 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.738794 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.738946 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.739099 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.739238 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.739433 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.739600 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.739745 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.739926 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.740062 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.740246 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.740394 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.740682 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.741048 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.741423 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.741740 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.741850 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.741966 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.742050 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.742319 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.742438 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.742640 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.742739 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.742956 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.743064 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.743283 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.743404 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.743679 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.743893 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.744217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.744597 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.744712 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.744920 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.745025 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.745251 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.745350 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.745574 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.745673 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.745892 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.745990 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.746200 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.746319 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.746525 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.746652 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.746838 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.746999 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.747145 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.747381 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.747486 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.747720 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.747812 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.748032 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.748132 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.748341 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.748461 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.748682 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.748774 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.748993 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.749093 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.749298 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.749409 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.749609 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.749738 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.749934 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.750032 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.750247 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.750404 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.750559 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.750690 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.750866 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.750981 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.751179 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.751298 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.751488 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.751642 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.751790 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.752032 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.752183 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.752382 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.752539 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.752710 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.752900 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.753025 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.753301 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.753399 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.753626 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.753730 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.753930 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.754244 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.754349 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.754551 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.754752 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.754852 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.755174 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.755281 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.755519 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.755722 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.755815 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.756077 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.756168 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.756391 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.756513 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.756737 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.756835 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.757084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.757207 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.757393 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.757530 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.757705 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.757805 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.758042 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.758141 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.758367 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.758471 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.758681 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.758913 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.759037 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.759275 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.759597 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.759885 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.759986 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.760251 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.760344 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.760586 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.760692 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.760893 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.760994 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.761219 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.761319 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.761539 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.761691 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.761856 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.762060 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.762214 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.762355 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.762598 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.762739 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.762888 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.763038 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.763178 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.763329 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.763477 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.763618 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.763768 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.763910 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.764069 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.764222 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.764370 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.764491 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.764591 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.764688 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.764829 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.765018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.765134 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.765667 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.765774 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.765982 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.766089 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.766296 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.766389 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.766607 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.766701 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.766961 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.767078 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.767280 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.767386 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.767600 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.767701 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.767912 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.768020 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.768223 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.768324 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.768569 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.768680 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.768880 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.768983 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.769199 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.769293 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.769529 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.769620 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.769842 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.769934 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.770146 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.770249 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.770474 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.770669 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.770797 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.770983 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.771119 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.771305 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.771444 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.771649 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.771820 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.771929 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.772067 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.772250 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.772388 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.772625 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.772741 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.772920 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.773241 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.773344 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.773555 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.773657 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.773885 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.773984 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.774217 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.774307 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.774533 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.774703 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.774921 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.775224 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.775459 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.775711 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.775812 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.776021 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.776121 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.776333 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.776544 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.776682 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.776786 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.777076 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.777174 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.777304 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.777401 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.777606 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.777710 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.777916 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.778014 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.778224 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.778325 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.778528 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.778652 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.778833 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.778977 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.779138 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.779301 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.779446 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.779624 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.779744 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.779990 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.780083 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.780319 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.780459 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.780652 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.780742 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.780957 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.781069 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.781259 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.781453 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.781728 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.781812 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.781926 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.782026 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.782148 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.782244 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.782452 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.782553 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.782759 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.782862 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.783059 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.783153 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.783392 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.783484 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.783708 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.783807 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.784024 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.784107 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.784382 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.784518 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.784706 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.784808 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.785033 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.785129 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.785345 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.785444 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.785663 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.785764 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.785982 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.786074 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.786294 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.786498 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.786622 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.786817 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.786931 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.787156 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.787256 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.787488 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.787593 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.787842 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.787942 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.788129 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.788222 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.788453 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.788562 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.788767 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.788865 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.789094 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.789186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.789404 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.789509 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.789713 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.789803 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.790029 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.790126 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.790363 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.790466 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.790842 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.791147 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.791246 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.791464 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.791564 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.791777 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.791882 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.792098 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.792190 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.792421 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.792530 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.792747 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.792970 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.793064 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.793325 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.793431 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.793645 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.793748 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.793960 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.794051 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.794288 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.794387 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.794606 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.794704 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.794911 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.795009 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.795235 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.795336 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.795546 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.795681 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.795857 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.795964 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.796198 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.796311 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.796569 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.796673 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.796898 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.797185 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.797278 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.797501 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.797610 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.797820 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.797921 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.798052 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117793) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 25 16:05:18.798160 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.798416 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.798734 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.799045 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.799381 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.799693 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.800009 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.800319 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.800663 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.800978 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.801289 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.801638 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.801970 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.802459 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.802843 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.803271 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.803643 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.803965 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.804440 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.804899 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.805434 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.805771 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.806395 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.807064 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.807394 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.807713 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.808048 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.808366 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.808714 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.809070 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.809395 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.809965 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.810293 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.810620 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.810961 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.811299 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.811608 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.811919 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.812300 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.812578 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.812895 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.813212 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.813526 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.813845 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.814157 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.814470 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.814784 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.815097 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.815409 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.815768 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.816033 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.816346 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.816686 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.817004 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.817352 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.818307 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.818641 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.818966 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.819295 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.819613 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.819935 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.820250 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.820590 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.820920 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.821259 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.821670 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.822398 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.822941 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.823286 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.823598 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.823931 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.824250 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.824612 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.824946 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.825268 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.825598 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.825915 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.826251 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.826599 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.826935 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.827267 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.827580 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.827892 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.828203 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.828538 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.828864 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.829182 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.829489 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.829796 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.830116 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.830424 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.830732 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.831041 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.831346 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.831657 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.831962 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.832271 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.832605 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.832909 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.833215 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.833523 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.833832 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.834141 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.834449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.834756 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.835062 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.835366 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.835707 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.836045 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.836364 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.836718 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.837039 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.837860 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.838188 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.838522 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.838849 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.839174 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.839493 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.839831 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.840153 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.842500 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.842500 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.842500 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.842500 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.842500 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.842500 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.842500 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.843113 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.843113 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.843298 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.843626 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.843948 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.844367 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.844931 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.845258 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.845576 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.845903 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.846223 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.846542 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.846866 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.847188 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.847524 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.847859 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.848308 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.848762 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.849284 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.849761 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.850165 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.850686 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.851190 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.851651 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.851974 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.852289 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 25 16:05:18.852579 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117794) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 25 16:05:18.860545 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO dbcounter [None req-ece8fe16-4b72-42fb-a0ac-4744ac041381 None None] Registered counter for database nova_api Jun 25 16:05:18.880841 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_db.sqlalchemy.engines [None req-ece8fe16-4b72-42fb-a0ac-4744ac041381 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 16:05:18.887513 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writer thread running {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 16:05:18.920070 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO dbcounter [None req-3869f8a6-6528-4ef4-818b-1e29dd0f1006 None None] Registered counter for database nova_api Jun 25 16:05:18.941121 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_db.sqlalchemy.engines [None req-3869f8a6-6528-4ef4-818b-1e29dd0f1006 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117794) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 16:05:18.944369 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.context [None req-ece8fe16-4b72-42fb-a0ac-4744ac041381 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),53447464-e1f9-46ac-a935-41c9e2d241f6(cell1) {{(pid=117793) load_cells /opt/stack/nova/nova/context.py:464}} Jun 25 16:05:18.948774 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ece8fe16-4b72-42fb-a0ac-4744ac041381 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:05:18.949187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writer thread running {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 16:05:18.950366 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ece8fe16-4b72-42fb-a0ac-4744ac041381 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:05:18.951165 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ece8fe16-4b72-42fb-a0ac-4744ac041381 None None] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:05:18.953162 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ece8fe16-4b72-42fb-a0ac-4744ac041381 None None] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:05:18.955177 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO dbcounter [None req-ece8fe16-4b72-42fb-a0ac-4744ac041381 None None] Registered counter for database nova_cell0 Jun 25 16:05:18.959300 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO dbcounter [None req-ece8fe16-4b72-42fb-a0ac-4744ac041381 None None] Registered counter for database nova_cell1 Jun 25 16:05:18.966885 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_db.sqlalchemy.engines [None req-ece8fe16-4b72-42fb-a0ac-4744ac041381 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 16:05:18.969329 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_db.sqlalchemy.engines [None req-ece8fe16-4b72-42fb-a0ac-4744ac041381 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 16:05:18.975144 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writer thread running {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 16:05:18.976480 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writer thread running {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 16:05:19.010700 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.context [None req-3869f8a6-6528-4ef4-818b-1e29dd0f1006 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),53447464-e1f9-46ac-a935-41c9e2d241f6(cell1) {{(pid=117794) load_cells /opt/stack/nova/nova/context.py:464}} Jun 25 16:05:19.015128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3869f8a6-6528-4ef4-818b-1e29dd0f1006 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:05:19.017081 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3869f8a6-6528-4ef4-818b-1e29dd0f1006 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:05:19.017894 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3869f8a6-6528-4ef4-818b-1e29dd0f1006 None None] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:05:19.019875 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3869f8a6-6528-4ef4-818b-1e29dd0f1006 None None] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:05:19.021935 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO dbcounter [None req-3869f8a6-6528-4ef4-818b-1e29dd0f1006 None None] Registered counter for database nova_cell0 Jun 25 16:05:19.027012 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO dbcounter [None req-3869f8a6-6528-4ef4-818b-1e29dd0f1006 None None] Registered counter for database nova_cell1 Jun 25 16:05:19.034834 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_db.sqlalchemy.engines [None req-3869f8a6-6528-4ef4-818b-1e29dd0f1006 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117794) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 16:05:19.035841 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_db.sqlalchemy.engines [None req-3869f8a6-6528-4ef4-818b-1e29dd0f1006 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117794) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 16:05:19.043586 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writer thread running {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 16:05:19.045313 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writer thread running {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 16:05:19.127107 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO dbcounter [None req-ece8fe16-4b72-42fb-a0ac-4744ac041381 None None] Registered counter for database nova_cell0 Jun 25 16:05:19.136257 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_db.sqlalchemy.engines [None req-ece8fe16-4b72-42fb-a0ac-4744ac041381 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117793) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 16:05:19.141710 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writer thread running {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 16:05:19.197580 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO dbcounter [None req-3869f8a6-6528-4ef4-818b-1e29dd0f1006 None None] Registered counter for database nova_cell0 Jun 25 16:05:19.206415 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_db.sqlalchemy.engines [None req-3869f8a6-6528-4ef4-818b-1e29dd0f1006 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117794) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 25 16:05:19.211106 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writer thread running {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 25 16:05:19.455768 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: WARNING keystonemiddleware.auth_token [None req-ece8fe16-4b72-42fb-a0ac-4744ac041381 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 25 16:05:19.463302 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: WARNING keystonemiddleware.auth_token [None req-ece8fe16-4b72-42fb-a0ac-4744ac041381 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 25 16:05:19.564225 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: WARNING keystonemiddleware.auth_token [None req-3869f8a6-6528-4ef4-818b-1e29dd0f1006 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 25 16:05:19.576045 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: WARNING keystonemiddleware.auth_token [None req-3869f8a6-6528-4ef4-818b-1e29dd0f1006 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 25 16:05:19.802829 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: WARNING keystonemiddleware.auth_token [None req-ece8fe16-4b72-42fb-a0ac-4744ac041381 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 25 16:05:19.809190 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: WARNING keystonemiddleware.auth_token [None req-ece8fe16-4b72-42fb-a0ac-4744ac041381 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 25 16:05:19.814971 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a668eea9c0 pid: 117793 (default app) Jun 25 16:05:19.944426 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: WARNING keystonemiddleware.auth_token [None req-3869f8a6-6528-4ef4-818b-1e29dd0f1006 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 25 16:05:19.950583 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: WARNING keystonemiddleware.auth_token [None req-3869f8a6-6528-4ef4-818b-1e29dd0f1006 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 25 16:05:19.957267 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a668eea9c0 pid: 117794 (default app) Jun 25 16:06:00.777555 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=3 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:06:00.779693 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=3 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:06:00.781516 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=3 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:06:00.783709 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=3 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:06:02.529372 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-62a578a5-8eca-4939-a36c-daaa95b490d8 tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] Action: 'create', calling method: .version_select at 0x7f65c15f2700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1157491316"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:06:05.221322 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-62a578a5-8eca-4939-a36c-daaa95b490d8 tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.449465 Jun 25 16:06:05.226157 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 1/1] 10.222.0.13 () {60 vars in 1154 bytes} [Sat Jun 25 16:06:00 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4456 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 25 16:06:06.112835 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-bd4385b3-3055-46e1-851a-2aa7a4ad628a tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] Calling method '.version_select at 0x7f65c16a2280>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:06.227413 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_api:SELECT=3 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:06:06.227413 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=3 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:06:06.227413 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell0:SELECT=3 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:06:06.227413 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell0:SELECT=3 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:06:07.299445 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-bd4385b3-3055-46e1-851a-2aa7a4ad628a tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/837661ae-ca0e-44ae-8c67-bee5fa48ed26" status: 200 len: 346 microversion: 2.1 time: 2.057104 Jun 25 16:06:07.299445 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 1/2] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Jun 25 16:06:05 2022] GET /compute/v2.1/os-volumes/837661ae-ca0e-44ae-8c67-bee5fa48ed26 => generated 346 bytes in 2059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:06:07.305802 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-da80a9b0-e9ab-4f17-b2e7-607f42eda46c tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] Action: 'create', calling method: .version_select at 0x7f65c14b94c0>, body: {"snapshot": {"volume_id": "837661ae-ca0e-44ae-8c67-bee5fa48ed26", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1397928823"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:06:07.782898 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-da80a9b0-e9ab-4f17-b2e7-607f42eda46c tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] 10.222.0.13 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.481448 Jun 25 16:06:07.783727 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 2/3] 10.222.0.13 () {60 vars in 1161 bytes} [Sat Jun 25 16:06:07 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:06:07.795176 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-7b262681-00b7-4410-851a-daeee8290b64 tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] Calling method '.version_select at 0x7f65c14f85e0>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:07.902452 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-7b262681-00b7-4410-851a-daeee8290b64 tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/f6220f99-80fd-41c7-b0e6-170486d2eaad" status: 200 len: 287 microversion: 2.1 time: 0.112406 Jun 25 16:06:07.903494 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 2/4] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Jun 25 16:06:07 2022] GET /compute/v2.1/os-snapshots/f6220f99-80fd-41c7-b0e6-170486d2eaad => generated 287 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:06:07.912931 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-cffd8f7e-f787-43ed-8de5-0699eca1521d tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] Calling method '.version_select at 0x7f65c14b9550>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:08.102482 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-cffd8f7e-f787-43ed-8de5-0699eca1521d tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.193229 Jun 25 16:06:08.104081 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 3/5] 10.222.0.13 () {58 vars in 1139 bytes} [Sat Jun 25 16:06:07 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:06:08.113693 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-868b6439-e755-48a5-bf5c-80315319af37 tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] Calling method '.version_select at 0x7f65c14f8790>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:08.228755 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-868b6439-e755-48a5-bf5c-80315319af37 tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/f6220f99-80fd-41c7-b0e6-170486d2eaad" status: 200 len: 287 microversion: 2.1 time: 0.118757 Jun 25 16:06:08.229621 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 3/6] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Jun 25 16:06:08 2022] GET /compute/v2.1/os-snapshots/f6220f99-80fd-41c7-b0e6-170486d2eaad => generated 287 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:06:09.240809 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b94532ce-d5af-466a-bba9-afa7f7ed3d51 tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] Calling method '.version_select at 0x7f65c1451280>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:09.290776 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b94532ce-d5af-466a-bba9-afa7f7ed3d51 tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/f6220f99-80fd-41c7-b0e6-170486d2eaad" status: 200 len: 287 microversion: 2.1 time: 0.053577 Jun 25 16:06:09.291914 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 4/7] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Jun 25 16:06:09 2022] GET /compute/v2.1/os-snapshots/f6220f99-80fd-41c7-b0e6-170486d2eaad => generated 287 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:06:10.302715 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-9f5cb7c1-28bc-449f-b38a-0945c418ef42 tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] Calling method '.version_select at 0x7f65c14f8dc0>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:10.350176 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-9f5cb7c1-28bc-449f-b38a-0945c418ef42 tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/f6220f99-80fd-41c7-b0e6-170486d2eaad" status: 200 len: 287 microversion: 2.1 time: 0.051147 Jun 25 16:06:10.350991 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 4/8] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Jun 25 16:06:10 2022] GET /compute/v2.1/os-snapshots/f6220f99-80fd-41c7-b0e6-170486d2eaad => generated 287 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:06:11.355329 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4d7f9315-ab78-4442-aa97-c518e2a23e50 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-497826914", "imageRef": "84c164fa-276d-4693-b7a0-24fd3024b359", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:06:11.362400 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-c63f26b8-19c9-4923-940c-e87d43b87736 tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] Calling method '.version_select at 0x7f65c14c14c0>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:11.432699 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-c63f26b8-19c9-4923-940c-e87d43b87736 tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/f6220f99-80fd-41c7-b0e6-170486d2eaad" status: 200 len: 288 microversion: 2.1 time: 0.074217 Jun 25 16:06:11.438537 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 5/9] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Jun 25 16:06:11 2022] GET /compute/v2.1/os-snapshots/f6220f99-80fd-41c7-b0e6-170486d2eaad => generated 288 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:06:11.448392 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-a0e4efcd-8c73-4212-b0f7-0e0bba66e0af tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] Calling method '.version_select at 0x7f65c14c1b80>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:11.576669 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-4d7f9315-ab78-4442-aa97-c518e2a23e50 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] validate_networks() for [('bd043e97-1059-4931-b819-353216eaa430', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 16:06:11.621345 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-a0e4efcd-8c73-4212-b0f7-0e0bba66e0af tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] 10.222.0.13 "DELETE /compute/v2.1/os-snapshots/f6220f99-80fd-41c7-b0e6-170486d2eaad" status: 202 len: 0 microversion: 2.1 time: 0.176735 Jun 25 16:06:11.621921 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 6/10] 10.222.0.13 () {58 vars in 1253 bytes} [Sat Jun 25 16:06:11 2022] DELETE /compute/v2.1/os-snapshots/f6220f99-80fd-41c7-b0e6-170486d2eaad => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 25 16:06:11.630981 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-7a7082bb-bcac-4bb9-bc55-701f9988d97e tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] Calling method '.version_select at 0x7f65c14f8ca0>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:11.712201 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-7a7082bb-bcac-4bb9-bc55-701f9988d97e tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/f6220f99-80fd-41c7-b0e6-170486d2eaad" status: 200 len: 287 microversion: 2.1 time: 0.085270 Jun 25 16:06:11.713095 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 7/11] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Jun 25 16:06:11 2022] GET /compute/v2.1/os-snapshots/f6220f99-80fd-41c7-b0e6-170486d2eaad => generated 287 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 16:06:12.723911 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-9ae71821-d23c-472e-bb7a-e8881e4f86c7 tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] Calling method '.version_select at 0x7f65c14f8700>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:12.779467 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.wsgi [None req-9ae71821-d23c-472e-bb7a-e8881e4f86c7 tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] HTTP exception thrown: Snapshot f6220f99-80fd-41c7-b0e6-170486d2eaad could not be found. Jun 25 16:06:12.784139 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-9ae71821-d23c-472e-bb7a-e8881e4f86c7 tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] Request method failure captured: Jun 25 16:06:12.784139 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: request: GET /compute/v2.1/os-snapshots/f6220f99-80fd-41c7-b0e6-170486d2eaad HTTP/1.1 Jun 25 16:06:12.784139 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept: application/json Jun 25 16:06:12.784139 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept-Encoding: identity Jun 25 16:06:12.784139 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Connection: close Jun 25 16:06:12.784139 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Length: 0 Jun 25 16:06:12.784139 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Type: application/json Jun 25 16:06:12.784139 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Host: 10.222.0.13 Jun 25 16:06:12.784139 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Openstack-System-Scope: None Jun 25 16:06:12.784139 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: User-Agent: python-urllib3/1.26.9 Jun 25 16:06:12.784139 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Auth-Token: gAAAAABitzJoF0cqOVMgm9gWfP5ATXtoPPl8J5EpuSwE8UY1lKFymG5fz1RZ8PBVpQsCiDuSSYf6rXlchUTIZWkSM4ReUC5_IPxRdPStXg-C8TrYnRFtthof1C_y7kXGprSLkdlyUA5ghK1j4Xg6a4nDogcyLj112aeflueN0SyqzAAWo52tshA Jun 25 16:06:12.784139 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Id: None Jun 25 16:06:12.784139 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Name: None Jun 25 16:06:12.784139 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Identity-Status: Confirmed Jun 25 16:06:12.784139 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Is-Admin-Project: True Jun 25 16:06:12.784139 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Id: default Jun 25 16:06:12.784139 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Name: Default Jun 25 16:06:12.784139 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Id: 8ef564f495b4489e98a852ad9fb7c5bd Jun 25 16:06:12.784139 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-524627053 Jun 25 16:06:12.784139 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Role: reader,member Jun 25 16:06:12.784139 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Roles: reader,member Jun 25 16:06:12.785214 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8ef564f495b4489e98a852ad9fb7c5bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8ef564f495b4489e98a852ad9fb7c5bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8ef564f495b4489e98a852ad9fb7c5bd", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8ef564f495b4489e98a852ad9fb7c5bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:06:12.785214 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant: tempest-VolumesSnapshotsTestJSON-524627053 Jun 25 16:06:12.785214 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Id: 8ef564f495b4489e98a852ad9fb7c5bd Jun 25 16:06:12.785214 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-524627053 Jun 25 16:06:12.785214 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User: tempest-VolumesSnapshotsTestJSON-524627053-project Jun 25 16:06:12.785214 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Id: default Jun 25 16:06:12.785214 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Name: Default Jun 25 16:06:12.785214 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Id: 33533f18b16f48e08babc4c07956a0d6 Jun 25 16:06:12.785214 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Name: tempest-VolumesSnapshotsTestJSON-524627053-project Jun 25 16:06:12.785214 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: method: Jun 25 16:06:12.785214 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: exception: Snapshot f6220f99-80fd-41c7-b0e6-170486d2eaad could not be found. Jun 25 16:06:12.785214 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: action_args: {'id': 'f6220f99-80fd-41c7-b0e6-170486d2eaad'} Jun 25 16:06:12.785214 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:06:12.785807 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:06:12.785807 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 25 16:06:12.785807 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 25 16:06:12.785807 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 25 16:06:12.785807 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 25 16:06:12.785807 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 25 16:06:12.785807 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 25 16:06:12.785807 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 25 16:06:12.785807 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 25 16:06:12.785807 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 25 16:06:12.785807 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 25 16:06:12.785807 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 16:06:12.785807 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 16:06:12.785807 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 16:06:12.785807 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 16:06:12.785807 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f6220f99-80fd-41c7-b0e6-170486d2eaad could not be found. (HTTP 404) (Request-ID: req-65e30520-735b-4591-a0b5-6aab6b49d8de) Jun 25 16:06:12.785807 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:06:12.785807 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:06:12.786589 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:06:12.786589 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:06:12.786589 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 25 16:06:12.786589 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 25 16:06:12.786589 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 25 16:06:12.786589 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 25 16:06:12.786589 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 25 16:06:12.786589 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 25 16:06:12.786589 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 25 16:06:12.786589 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 25 16:06:12.786589 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 25 16:06:12.786589 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 25 16:06:12.786589 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 25 16:06:12.786589 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 25 16:06:12.786589 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 25 16:06:12.786589 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 25 16:06:12.786589 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 25 16:06:12.786589 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 25 16:06:12.786589 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 25 16:06:12.787428 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 25 16:06:12.787428 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 16:06:12.787428 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 16:06:12.787428 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 16:06:12.787428 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 16:06:12.787428 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f6220f99-80fd-41c7-b0e6-170486d2eaad could not be found. Jun 25 16:06:12.787428 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:06:12.787428 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:06:12.787428 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:06:12.787428 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:06:12.787428 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:06:12.787428 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:06:12.787428 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:06:12.787428 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:06:12.787428 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 16:06:12.787428 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 16:06:12.787428 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:06:12.787428 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:06:12.787428 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 25 16:06:12.787428 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:06:12.788323 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f6220f99-80fd-41c7-b0e6-170486d2eaad could not be found. Jun 25 16:06:12.788323 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:06:12.788323 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:06:12.788323 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:06:12.788323 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:06:12.788323 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:06:12.788323 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:06:12.788323 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:06:12.788323 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:06:12.788323 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f6220f99-80fd-41c7-b0e6-170486d2eaad could not be found. Jun 25 16:06:12.788323 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:06:12.790677 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-9ae71821-d23c-472e-bb7a-e8881e4f86c7 tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] Returning 404 to user: Snapshot f6220f99-80fd-41c7-b0e6-170486d2eaad could not be found. {{(pid=117794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:06:12.791869 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-9ae71821-d23c-472e-bb7a-e8881e4f86c7 tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/f6220f99-80fd-41c7-b0e6-170486d2eaad" status: 404 len: 111 microversion: 2.1 time: 0.072109 Jun 25 16:06:12.793242 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 8/12] 10.222.0.13 () {58 vars in 1250 bytes} [Sat Jun 25 16:06:12 2022] GET /compute/v2.1/os-snapshots/f6220f99-80fd-41c7-b0e6-170486d2eaad => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 16:06:12.806260 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-d14088df-afda-460d-8281-d60a06c4651c tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] Calling method '.version_select at 0x7f65c14c1f70>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:12.963330 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-d14088df-afda-460d-8281-d60a06c4651c tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/837661ae-ca0e-44ae-8c67-bee5fa48ed26" status: 202 len: 0 microversion: 2.1 time: 0.165686 Jun 25 16:06:12.967397 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 9/13] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Jun 25 16:06:12 2022] DELETE /compute/v2.1/os-volumes/837661ae-ca0e-44ae-8c67-bee5fa48ed26 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 16:06:12.972832 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-345448fa-6fc2-489b-83bb-39d690f7092d tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] Calling method '.version_select at 0x7f65c1420670>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:13.101133 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-345448fa-6fc2-489b-83bb-39d690f7092d tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/837661ae-ca0e-44ae-8c67-bee5fa48ed26" status: 200 len: 345 microversion: 2.1 time: 0.132205 Jun 25 16:06:13.102622 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 10/14] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Jun 25 16:06:12 2022] GET /compute/v2.1/os-volumes/837661ae-ca0e-44ae-8c67-bee5fa48ed26 => generated 345 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:06:14.116034 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-43a4dab4-17b6-4d2c-b275-bf8d8f645d47 tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] Calling method '.version_select at 0x7f65c1420d30>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:14.181464 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.wsgi [None req-43a4dab4-17b6-4d2c-b275-bf8d8f645d47 tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] HTTP exception thrown: Volume 837661ae-ca0e-44ae-8c67-bee5fa48ed26 could not be found. Jun 25 16:06:14.188355 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-43a4dab4-17b6-4d2c-b275-bf8d8f645d47 tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] Request method failure captured: Jun 25 16:06:14.188355 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: request: GET /compute/v2.1/os-volumes/837661ae-ca0e-44ae-8c67-bee5fa48ed26 HTTP/1.1 Jun 25 16:06:14.188355 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept: application/json Jun 25 16:06:14.188355 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept-Encoding: identity Jun 25 16:06:14.188355 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Connection: close Jun 25 16:06:14.188355 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Length: 0 Jun 25 16:06:14.188355 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Type: application/json Jun 25 16:06:14.188355 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Host: 10.222.0.13 Jun 25 16:06:14.188355 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Openstack-System-Scope: None Jun 25 16:06:14.188355 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: User-Agent: python-urllib3/1.26.9 Jun 25 16:06:14.188355 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Auth-Token: gAAAAABitzJoF0cqOVMgm9gWfP5ATXtoPPl8J5EpuSwE8UY1lKFymG5fz1RZ8PBVpQsCiDuSSYf6rXlchUTIZWkSM4ReUC5_IPxRdPStXg-C8TrYnRFtthof1C_y7kXGprSLkdlyUA5ghK1j4Xg6a4nDogcyLj112aeflueN0SyqzAAWo52tshA Jun 25 16:06:14.188355 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Id: None Jun 25 16:06:14.188355 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Name: None Jun 25 16:06:14.188355 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Identity-Status: Confirmed Jun 25 16:06:14.188355 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Is-Admin-Project: True Jun 25 16:06:14.188355 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Id: default Jun 25 16:06:14.188355 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Name: Default Jun 25 16:06:14.188355 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Id: 8ef564f495b4489e98a852ad9fb7c5bd Jun 25 16:06:14.188355 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-524627053 Jun 25 16:06:14.188355 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Role: reader,member Jun 25 16:06:14.188355 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Roles: reader,member Jun 25 16:06:14.189604 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8ef564f495b4489e98a852ad9fb7c5bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8ef564f495b4489e98a852ad9fb7c5bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8ef564f495b4489e98a852ad9fb7c5bd", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8ef564f495b4489e98a852ad9fb7c5bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:06:14.189604 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant: tempest-VolumesSnapshotsTestJSON-524627053 Jun 25 16:06:14.189604 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Id: 8ef564f495b4489e98a852ad9fb7c5bd Jun 25 16:06:14.189604 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-524627053 Jun 25 16:06:14.189604 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User: tempest-VolumesSnapshotsTestJSON-524627053-project Jun 25 16:06:14.189604 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Id: default Jun 25 16:06:14.189604 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Name: Default Jun 25 16:06:14.189604 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Id: 33533f18b16f48e08babc4c07956a0d6 Jun 25 16:06:14.189604 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Name: tempest-VolumesSnapshotsTestJSON-524627053-project Jun 25 16:06:14.189604 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: method: Jun 25 16:06:14.189604 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: exception: Volume 837661ae-ca0e-44ae-8c67-bee5fa48ed26 could not be found. Jun 25 16:06:14.189604 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: action_args: {'id': '837661ae-ca0e-44ae-8c67-bee5fa48ed26'} Jun 25 16:06:14.189604 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:06:14.190256 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:06:14.190256 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 25 16:06:14.190256 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 25 16:06:14.190256 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 25 16:06:14.190256 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 25 16:06:14.190256 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 25 16:06:14.190256 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 25 16:06:14.190256 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 25 16:06:14.190256 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 25 16:06:14.190256 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 25 16:06:14.190256 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 25 16:06:14.190256 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 16:06:14.190256 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 16:06:14.190256 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 16:06:14.190256 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 16:06:14.190256 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 837661ae-ca0e-44ae-8c67-bee5fa48ed26 could not be found. (HTTP 404) (Request-ID: req-8ae424af-9f57-4358-8bf3-8667b62c9aa3) Jun 25 16:06:14.190256 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:06:14.190256 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:06:14.190256 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:06:14.191075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:06:14.191075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 25 16:06:14.191075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 25 16:06:14.191075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 25 16:06:14.191075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 25 16:06:14.191075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 25 16:06:14.191075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 25 16:06:14.191075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 25 16:06:14.191075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 25 16:06:14.191075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 25 16:06:14.191075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 25 16:06:14.191075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 25 16:06:14.191075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 25 16:06:14.191075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 25 16:06:14.191075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 25 16:06:14.191075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 25 16:06:14.191075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 25 16:06:14.191075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 25 16:06:14.191075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 25 16:06:14.191897 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 16:06:14.191897 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 16:06:14.191897 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 16:06:14.191897 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 16:06:14.191897 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 837661ae-ca0e-44ae-8c67-bee5fa48ed26 could not be found. Jun 25 16:06:14.191897 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:06:14.191897 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:06:14.191897 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:06:14.191897 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:06:14.191897 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:06:14.191897 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:06:14.191897 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:06:14.191897 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:06:14.191897 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 16:06:14.191897 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 16:06:14.191897 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:06:14.191897 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:06:14.191897 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 25 16:06:14.191897 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:06:14.192946 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 837661ae-ca0e-44ae-8c67-bee5fa48ed26 could not be found. Jun 25 16:06:14.192946 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:06:14.192946 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:06:14.192946 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:06:14.192946 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:06:14.192946 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:06:14.192946 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:06:14.192946 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:06:14.192946 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:06:14.192946 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 837661ae-ca0e-44ae-8c67-bee5fa48ed26 could not be found. Jun 25 16:06:14.192946 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:06:14.195137 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-43a4dab4-17b6-4d2c-b275-bf8d8f645d47 tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] Returning 404 to user: Volume 837661ae-ca0e-44ae-8c67-bee5fa48ed26 could not be found. {{(pid=117794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:06:14.196385 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-43a4dab4-17b6-4d2c-b275-bf8d8f645d47 tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/837661ae-ca0e-44ae-8c67-bee5fa48ed26" status: 404 len: 109 microversion: 2.1 time: 0.085321 Jun 25 16:06:14.197133 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 11/15] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Jun 25 16:06:14 2022] GET /compute/v2.1/os-volumes/837661ae-ca0e-44ae-8c67-bee5fa48ed26 => generated 109 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:06:14.211171 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-2e9e40f9-26bd-4904-ab03-f674be4bcca2 tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] Calling method '.version_select at 0x7f65c14203a0>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:14.291737 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.wsgi [None req-2e9e40f9-26bd-4904-ab03-f674be4bcca2 tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] HTTP exception thrown: Volume 837661ae-ca0e-44ae-8c67-bee5fa48ed26 could not be found. Jun 25 16:06:14.293756 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-2e9e40f9-26bd-4904-ab03-f674be4bcca2 tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] Request method failure captured: Jun 25 16:06:14.293756 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: request: DELETE /compute/v2.1/os-volumes/837661ae-ca0e-44ae-8c67-bee5fa48ed26 HTTP/1.1 Jun 25 16:06:14.293756 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept: application/json Jun 25 16:06:14.293756 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept-Encoding: identity Jun 25 16:06:14.293756 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Connection: close Jun 25 16:06:14.293756 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Length: 0 Jun 25 16:06:14.293756 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Type: application/json Jun 25 16:06:14.293756 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Host: 10.222.0.13 Jun 25 16:06:14.293756 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Openstack-System-Scope: None Jun 25 16:06:14.293756 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: User-Agent: python-urllib3/1.26.9 Jun 25 16:06:14.293756 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Auth-Token: gAAAAABitzJoF0cqOVMgm9gWfP5ATXtoPPl8J5EpuSwE8UY1lKFymG5fz1RZ8PBVpQsCiDuSSYf6rXlchUTIZWkSM4ReUC5_IPxRdPStXg-C8TrYnRFtthof1C_y7kXGprSLkdlyUA5ghK1j4Xg6a4nDogcyLj112aeflueN0SyqzAAWo52tshA Jun 25 16:06:14.293756 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Id: None Jun 25 16:06:14.293756 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Name: None Jun 25 16:06:14.293756 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Identity-Status: Confirmed Jun 25 16:06:14.293756 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Is-Admin-Project: True Jun 25 16:06:14.293756 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Id: default Jun 25 16:06:14.293756 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Name: Default Jun 25 16:06:14.293756 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Id: 8ef564f495b4489e98a852ad9fb7c5bd Jun 25 16:06:14.293756 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-524627053 Jun 25 16:06:14.293756 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Role: reader,member Jun 25 16:06:14.293756 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Roles: reader,member Jun 25 16:06:14.294829 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8ef564f495b4489e98a852ad9fb7c5bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8ef564f495b4489e98a852ad9fb7c5bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8ef564f495b4489e98a852ad9fb7c5bd", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8ef564f495b4489e98a852ad9fb7c5bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:06:14.294829 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant: tempest-VolumesSnapshotsTestJSON-524627053 Jun 25 16:06:14.294829 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Id: 8ef564f495b4489e98a852ad9fb7c5bd Jun 25 16:06:14.294829 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-524627053 Jun 25 16:06:14.294829 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User: tempest-VolumesSnapshotsTestJSON-524627053-project Jun 25 16:06:14.294829 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Id: default Jun 25 16:06:14.294829 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Name: Default Jun 25 16:06:14.294829 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Id: 33533f18b16f48e08babc4c07956a0d6 Jun 25 16:06:14.294829 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Name: tempest-VolumesSnapshotsTestJSON-524627053-project Jun 25 16:06:14.294829 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: method: Jun 25 16:06:14.294829 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: exception: Volume 837661ae-ca0e-44ae-8c67-bee5fa48ed26 could not be found. Jun 25 16:06:14.294829 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: action_args: {'id': '837661ae-ca0e-44ae-8c67-bee5fa48ed26'} Jun 25 16:06:14.294829 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:06:14.295436 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:06:14.295436 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 25 16:06:14.295436 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 25 16:06:14.295436 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 25 16:06:14.295436 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 25 16:06:14.295436 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 25 16:06:14.295436 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 25 16:06:14.295436 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 25 16:06:14.295436 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 25 16:06:14.295436 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 25 16:06:14.295436 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 25 16:06:14.295436 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 16:06:14.295436 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 16:06:14.295436 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 16:06:14.295436 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 16:06:14.295436 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 837661ae-ca0e-44ae-8c67-bee5fa48ed26 could not be found. (HTTP 404) (Request-ID: req-58c865d1-ee08-4b83-949e-91d4ac5adc86) Jun 25 16:06:14.295436 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:06:14.295436 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:06:14.295436 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:06:14.296298 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:06:14.296298 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 25 16:06:14.296298 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 25 16:06:14.296298 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 25 16:06:14.296298 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 25 16:06:14.296298 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 25 16:06:14.296298 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 25 16:06:14.296298 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 25 16:06:14.296298 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 25 16:06:14.296298 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 25 16:06:14.296298 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 25 16:06:14.296298 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 25 16:06:14.296298 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 25 16:06:14.296298 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 25 16:06:14.296298 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 25 16:06:14.296298 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 25 16:06:14.296298 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 25 16:06:14.296298 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 25 16:06:14.296298 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 25 16:06:14.297199 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 16:06:14.297199 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 16:06:14.297199 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 16:06:14.297199 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 16:06:14.297199 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 837661ae-ca0e-44ae-8c67-bee5fa48ed26 could not be found. Jun 25 16:06:14.297199 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:06:14.297199 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:06:14.297199 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:06:14.297199 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:06:14.297199 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:06:14.297199 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:06:14.297199 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:06:14.297199 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:06:14.297199 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 16:06:14.297199 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 16:06:14.297199 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:06:14.297199 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:06:14.297199 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 25 16:06:14.297199 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:06:14.298072 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 837661ae-ca0e-44ae-8c67-bee5fa48ed26 could not be found. Jun 25 16:06:14.298072 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:06:14.298072 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:06:14.298072 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:06:14.298072 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:06:14.298072 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:06:14.298072 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:06:14.298072 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:06:14.298072 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:06:14.298072 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 837661ae-ca0e-44ae-8c67-bee5fa48ed26 could not be found. Jun 25 16:06:14.298072 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:06:14.298072 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-2e9e40f9-26bd-4904-ab03-f674be4bcca2 tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] Returning 404 to user: Volume 837661ae-ca0e-44ae-8c67-bee5fa48ed26 could not be found. {{(pid=117794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:06:14.298072 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-2e9e40f9-26bd-4904-ab03-f674be4bcca2 tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/837661ae-ca0e-44ae-8c67-bee5fa48ed26" status: 404 len: 109 microversion: 2.1 time: 0.090676 Jun 25 16:06:14.301710 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 12/16] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Jun 25 16:06:14 2022] DELETE /compute/v2.1/os-volumes/837661ae-ca0e-44ae-8c67-bee5fa48ed26 => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:06:14.312759 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-1fb8ede6-bcdf-485d-9d55-dad6c1a8a729 tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] Calling method '.version_select at 0x7f65c1420940>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:14.357440 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.wsgi [None req-1fb8ede6-bcdf-485d-9d55-dad6c1a8a729 tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] HTTP exception thrown: Volume 837661ae-ca0e-44ae-8c67-bee5fa48ed26 could not be found. Jun 25 16:06:14.359635 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-1fb8ede6-bcdf-485d-9d55-dad6c1a8a729 tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] Request method failure captured: Jun 25 16:06:14.359635 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: request: GET /compute/v2.1/os-volumes/837661ae-ca0e-44ae-8c67-bee5fa48ed26 HTTP/1.1 Jun 25 16:06:14.359635 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept: application/json Jun 25 16:06:14.359635 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept-Encoding: identity Jun 25 16:06:14.359635 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Connection: close Jun 25 16:06:14.359635 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Length: 0 Jun 25 16:06:14.359635 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Type: application/json Jun 25 16:06:14.359635 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Host: 10.222.0.13 Jun 25 16:06:14.359635 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Openstack-System-Scope: None Jun 25 16:06:14.359635 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: User-Agent: python-urllib3/1.26.9 Jun 25 16:06:14.359635 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Auth-Token: gAAAAABitzJoF0cqOVMgm9gWfP5ATXtoPPl8J5EpuSwE8UY1lKFymG5fz1RZ8PBVpQsCiDuSSYf6rXlchUTIZWkSM4ReUC5_IPxRdPStXg-C8TrYnRFtthof1C_y7kXGprSLkdlyUA5ghK1j4Xg6a4nDogcyLj112aeflueN0SyqzAAWo52tshA Jun 25 16:06:14.359635 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Id: None Jun 25 16:06:14.359635 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Name: None Jun 25 16:06:14.359635 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Identity-Status: Confirmed Jun 25 16:06:14.359635 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Is-Admin-Project: True Jun 25 16:06:14.359635 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Id: default Jun 25 16:06:14.359635 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Name: Default Jun 25 16:06:14.359635 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Id: 8ef564f495b4489e98a852ad9fb7c5bd Jun 25 16:06:14.359635 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-524627053 Jun 25 16:06:14.359635 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Role: reader,member Jun 25 16:06:14.359635 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Roles: reader,member Jun 25 16:06:14.360939 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8ef564f495b4489e98a852ad9fb7c5bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8ef564f495b4489e98a852ad9fb7c5bd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8ef564f495b4489e98a852ad9fb7c5bd", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8ef564f495b4489e98a852ad9fb7c5bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:06:14.360939 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant: tempest-VolumesSnapshotsTestJSON-524627053 Jun 25 16:06:14.360939 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Id: 8ef564f495b4489e98a852ad9fb7c5bd Jun 25 16:06:14.360939 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-524627053 Jun 25 16:06:14.360939 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User: tempest-VolumesSnapshotsTestJSON-524627053-project Jun 25 16:06:14.360939 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Id: default Jun 25 16:06:14.360939 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Name: Default Jun 25 16:06:14.360939 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Id: 33533f18b16f48e08babc4c07956a0d6 Jun 25 16:06:14.360939 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Name: tempest-VolumesSnapshotsTestJSON-524627053-project Jun 25 16:06:14.360939 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: method: Jun 25 16:06:14.360939 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: exception: Volume 837661ae-ca0e-44ae-8c67-bee5fa48ed26 could not be found. Jun 25 16:06:14.360939 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: action_args: {'id': '837661ae-ca0e-44ae-8c67-bee5fa48ed26'} Jun 25 16:06:14.360939 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:06:14.361532 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:06:14.361532 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 25 16:06:14.361532 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 25 16:06:14.361532 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 25 16:06:14.361532 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 25 16:06:14.361532 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 25 16:06:14.361532 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 25 16:06:14.361532 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 25 16:06:14.361532 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 25 16:06:14.361532 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 25 16:06:14.361532 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 25 16:06:14.361532 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 16:06:14.361532 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 16:06:14.361532 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 16:06:14.361532 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 16:06:14.361532 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 837661ae-ca0e-44ae-8c67-bee5fa48ed26 could not be found. (HTTP 404) (Request-ID: req-83d0c030-6c1e-412e-9fb9-9c950213cf17) Jun 25 16:06:14.361532 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:06:14.361532 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:06:14.361532 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:06:14.362609 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:06:14.362609 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 25 16:06:14.362609 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 25 16:06:14.362609 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 25 16:06:14.362609 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 25 16:06:14.362609 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 25 16:06:14.362609 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 25 16:06:14.362609 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 25 16:06:14.362609 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 25 16:06:14.362609 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 25 16:06:14.362609 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 25 16:06:14.362609 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 25 16:06:14.362609 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 25 16:06:14.362609 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 25 16:06:14.362609 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 25 16:06:14.362609 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 25 16:06:14.362609 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 25 16:06:14.362609 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 25 16:06:14.362609 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 25 16:06:14.363459 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 16:06:14.363459 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 16:06:14.363459 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 16:06:14.363459 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 16:06:14.363459 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 837661ae-ca0e-44ae-8c67-bee5fa48ed26 could not be found. Jun 25 16:06:14.363459 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:06:14.363459 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:06:14.363459 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:06:14.363459 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:06:14.363459 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:06:14.363459 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:06:14.363459 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:06:14.363459 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:06:14.363459 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 16:06:14.363459 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 16:06:14.363459 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:06:14.363459 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:06:14.363459 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 25 16:06:14.363459 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:06:14.364449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 837661ae-ca0e-44ae-8c67-bee5fa48ed26 could not be found. Jun 25 16:06:14.364449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:06:14.364449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:06:14.364449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:06:14.364449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:06:14.364449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:06:14.364449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:06:14.364449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:06:14.364449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:06:14.364449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 837661ae-ca0e-44ae-8c67-bee5fa48ed26 could not be found. Jun 25 16:06:14.364449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:06:14.364449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-1fb8ede6-bcdf-485d-9d55-dad6c1a8a729 tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] Returning 404 to user: Volume 837661ae-ca0e-44ae-8c67-bee5fa48ed26 could not be found. {{(pid=117794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:06:14.367518 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-1fb8ede6-bcdf-485d-9d55-dad6c1a8a729 tempest-VolumesSnapshotsTestJSON-524627053 tempest-VolumesSnapshotsTestJSON-524627053-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/837661ae-ca0e-44ae-8c67-bee5fa48ed26" status: 404 len: 109 microversion: 2.1 time: 0.064602 Jun 25 16:06:14.376735 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 13/17] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Jun 25 16:06:14 2022] GET /compute/v2.1/os-volumes/837661ae-ca0e-44ae-8c67-bee5fa48ed26 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:06:15.858678 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-4d7f9315-ab78-4442-aa97-c518e2a23e50 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 16:06:15.859242 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-4d7f9315-ab78-4442-aa97-c518e2a23e50 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 16:06:15.860205 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-4d7f9315-ab78-4442-aa97-c518e2a23e50 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 16:06:15.860802 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-4d7f9315-ab78-4442-aa97-c518e2a23e50 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 16:06:15.861311 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-4d7f9315-ab78-4442-aa97-c518e2a23e50 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 16:06:15.886396 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4d7f9315-ab78-4442-aa97-c518e2a23e50 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:15.905243 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4d7f9315-ab78-4442-aa97-c518e2a23e50 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:15.906325 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4d7f9315-ab78-4442-aa97-c518e2a23e50 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:15.906881 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4d7f9315-ab78-4442-aa97-c518e2a23e50 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:16.007949 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-4d7f9315-ab78-4442-aa97-c518e2a23e50 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Getting quotas for project 9bcee16336834b80a389799f89b5b79a. Resources: {'ram', 'cores', 'instances'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:06:16.034068 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-4d7f9315-ab78-4442-aa97-c518e2a23e50 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Getting quotas for user 8a3137566b004edb909d4e3c702a7f59 and project 9bcee16336834b80a389799f89b5b79a. Resources: {'ram', 'cores', 'instances'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:06:16.076912 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4d7f9315-ab78-4442-aa97-c518e2a23e50 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 16:06:16.080145 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4d7f9315-ab78-4442-aa97-c518e2a23e50 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 7feaccc2-e2e8-4644-87a9-4b88cd8767d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84c164fa-276d-4693-b7a0-24fd3024b359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 16:06:16.229052 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4d7f9315-ab78-4442-aa97-c518e2a23e50 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.120125 Jun 25 16:06:16.230504 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 5/18] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Jun 25 16:06:11 2022] POST /compute/v2.1/servers => generated 383 bytes in 5122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 16:06:16.241062 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-3c11eec9-036a-47f7-8b65-a53b8d7e1057 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:16.242650 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-3c11eec9-036a-47f7-8b65-a53b8d7e1057 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 7feaccc2-e2e8-4644-87a9-4b88cd8767d5] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:16.541414 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-3c11eec9-036a-47f7-8b65-a53b8d7e1057 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:16.569749 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-3c11eec9-036a-47f7-8b65-a53b8d7e1057 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5" status: 200 len: 1221 microversion: 2.1 time: 0.332713 Jun 25 16:06:16.573008 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 14/19] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:16 2022] GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5 => generated 1221 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:06:16.813984 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5d956b86-ae40-4452-84c7-8ec1b453a539 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Action: 'create', calling method: .version_select at 0x7f65c0b5d0d0>, body: {"keypair": {"name": "tempest-keypair-2099754676", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPwGmHlUeecHA54q2qdsb39H38PqKQ4q7SY4OJH0CzckbSnjawy63GLCaEMYEXPqkjOX55SQ9tpY5vTRQxrZtSi9pld9Tlq3L0MiAW6dnlalwgSWHhyd6Tk/loPrMbV6jg=="}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:06:16.870046 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-5d956b86-ae40-4452-84c7-8ec1b453a539 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Getting quotas for project b1bba8f74dbd433bbffdb2ffbfc481fb. Resources: {'key_pairs'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:06:16.875456 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-5d956b86-ae40-4452-84c7-8ec1b453a539 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Getting quotas for user 19140330ae664e45b85f47f321496191 and project b1bba8f74dbd433bbffdb2ffbfc481fb. Resources: {'key_pairs'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:06:16.951514 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5d956b86-ae40-4452-84c7-8ec1b453a539 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.695497 Jun 25 16:06:16.952904 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 6/20] 10.222.0.13 () {60 vars in 1158 bytes} [Sat Jun 25 16:06:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 16:06:17.527379 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-91a879ac-cabe-4b74-86ba-59c05f319b52 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-863328133", "imageRef": "84c164fa-276d-4693-b7a0-24fd3024b359", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:06:17.730343 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.network.neutron [None req-91a879ac-cabe-4b74-86ba-59c05f319b52 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] validate_networks() for [('bd043e97-1059-4931-b819-353216eaa430', None, None, None, None, None)] {{(pid=117794) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 16:06:19.157358 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7721d973-d8f5-4b07-ac2b-3f96854abb30 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-126697549", "imageRef": "84c164fa-276d-4693-b7a0-24fd3024b359", "flavorRef": "452", "networks": [{"uuid": "8b9f6d93-00eb-41b6-97fc-bb6619ee796d"}]}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:06:19.337409 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-7721d973-d8f5-4b07-ac2b-3f96854abb30 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] validate_networks() for [('8b9f6d93-00eb-41b6-97fc-bb6619ee796d', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 16:06:20.621250 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-7721d973-d8f5-4b07-ac2b-3f96854abb30 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 16:06:20.622045 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-7721d973-d8f5-4b07-ac2b-3f96854abb30 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 16:06:20.622209 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-7721d973-d8f5-4b07-ac2b-3f96854abb30 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 16:06:20.622703 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-7721d973-d8f5-4b07-ac2b-3f96854abb30 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 16:06:20.623130 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-7721d973-d8f5-4b07-ac2b-3f96854abb30 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 16:06:20.658579 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7721d973-d8f5-4b07-ac2b-3f96854abb30 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:20.662269 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7721d973-d8f5-4b07-ac2b-3f96854abb30 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:20.665950 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7721d973-d8f5-4b07-ac2b-3f96854abb30 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:20.667389 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7721d973-d8f5-4b07-ac2b-3f96854abb30 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:20.697466 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-7721d973-d8f5-4b07-ac2b-3f96854abb30 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Getting quotas for project c348649c6b794f5c9339ea9506b6a16b. Resources: {'ram', 'cores', 'instances'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:06:20.703779 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-7721d973-d8f5-4b07-ac2b-3f96854abb30 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Getting quotas for user be06179595ef450a917d71fe4e6b2c5b and project c348649c6b794f5c9339ea9506b6a16b. Resources: {'ram', 'cores', 'instances'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:06:20.722672 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7721d973-d8f5-4b07-ac2b-3f96854abb30 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 16:06:20.726091 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7721d973-d8f5-4b07-ac2b-3f96854abb30 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84c164fa-276d-4693-b7a0-24fd3024b359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 16:06:20.847421 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7721d973-d8f5-4b07-ac2b-3f96854abb30 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.613036 Jun 25 16:06:20.858444 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 7/21] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Jun 25 16:06:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 25 16:06:20.864902 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-23f59cf5-3fc4-4324-9ef8-caa49cae5680 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:20.868253 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-23f59cf5-3fc4-4324-9ef8-caa49cae5680 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:21.670073 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-23f59cf5-3fc4-4324-9ef8-caa49cae5680 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:21.701345 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-23f59cf5-3fc4-4324-9ef8-caa49cae5680 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1214 microversion: 2.1 time: 0.841052 Jun 25 16:06:21.704516 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 8/22] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:20 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1214 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:22.168115 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-91a879ac-cabe-4b74-86ba-59c05f319b52 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Flavor limits 0:0:0 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 16:06:22.168708 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-91a879ac-cabe-4b74-86ba-59c05f319b52 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Image limits 0:0:0 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 16:06:22.169187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-91a879ac-cabe-4b74-86ba-59c05f319b52 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Flavor pref 0:0:0 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 16:06:22.170244 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-91a879ac-cabe-4b74-86ba-59c05f319b52 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Image pref 0:0:0 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 16:06:22.171115 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-91a879ac-cabe-4b74-86ba-59c05f319b52 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 16:06:22.225535 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-91a879ac-cabe-4b74-86ba-59c05f319b52 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:22.225986 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-91a879ac-cabe-4b74-86ba-59c05f319b52 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:22.236838 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-91a879ac-cabe-4b74-86ba-59c05f319b52 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:22.238707 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-91a879ac-cabe-4b74-86ba-59c05f319b52 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:22.371644 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.quota [None req-91a879ac-cabe-4b74-86ba-59c05f319b52 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Getting quotas for project 9bcee16336834b80a389799f89b5b79a. Resources: {'ram', 'cores', 'instances'} {{(pid=117794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:06:22.417311 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.quota [None req-91a879ac-cabe-4b74-86ba-59c05f319b52 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Getting quotas for user 8a3137566b004edb909d4e3c702a7f59 and project 9bcee16336834b80a389799f89b5b79a. Resources: {'ram', 'cores', 'instances'} {{(pid=117794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:06:22.485903 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-91a879ac-cabe-4b74-86ba-59c05f319b52 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Going to run 1 instances... {{(pid=117794) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 16:06:22.488764 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-91a879ac-cabe-4b74-86ba-59c05f319b52 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84c164fa-276d-4693-b7a0-24fd3024b359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 16:06:22.733507 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-057b48f1-3841-4aa3-bfb0-c52b3ab03912 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:22.734330 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-057b48f1-3841-4aa3-bfb0-c52b3ab03912 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:22.836171 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-91a879ac-cabe-4b74-86ba-59c05f319b52 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.314407 Jun 25 16:06:22.837990 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 15/23] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Jun 25 16:06:17 2022] POST /compute/v2.1/servers => generated 383 bytes in 5317 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 16:06:22.859320 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-d66049da-7f0b-4456-b61b-11a6b32e8049 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-572865861", "imageRef": "84c164fa-276d-4693-b7a0-24fd3024b359", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "92184934-9929-49a5-91f4-1ab03b25e2f1"}], "security_groups": [{"name": "tempest-securitygroup--1009096185"}], "key_name": "tempest-keypair-2099754676", "user_data": "}} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:06:22.933060 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-057b48f1-3841-4aa3-bfb0-c52b3ab03912 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:22.940391 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-057b48f1-3841-4aa3-bfb0-c52b3ab03912 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1214 microversion: 2.1 time: 0.211268 Jun 25 16:06:22.945672 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 9/24] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:22 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1214 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:06:22.958361 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-79ab0b28-54a3-4d51-b7f9-5ac7ce8fa6c3 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:22.958981 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-79ab0b28-54a3-4d51-b7f9-5ac7ce8fa6c3 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:23.131906 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-79ab0b28-54a3-4d51-b7f9-5ac7ce8fa6c3 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:23.147439 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-79ab0b28-54a3-4d51-b7f9-5ac7ce8fa6c3 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1221 microversion: 2.1 time: 0.195962 Jun 25 16:06:23.149287 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 10/25] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:22 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1221 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:23.235373 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.network.neutron [None req-d66049da-7f0b-4456-b61b-11a6b32e8049 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] validate_networks() for [('92184934-9929-49a5-91f4-1ab03b25e2f1', None, None, None, None, None)] {{(pid=117794) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 16:06:23.959885 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-03b72a3a-277a-4bbb-932a-5b0b9f2f622b tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:23.960703 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-03b72a3a-277a-4bbb-932a-5b0b9f2f622b tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:23.980895 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-03b72a3a-277a-4bbb-932a-5b0b9f2f622b tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:23.982736 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-03b72a3a-277a-4bbb-932a-5b0b9f2f622b tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:23.985941 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-03b72a3a-277a-4bbb-932a-5b0b9f2f622b tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:23.988938 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-03b72a3a-277a-4bbb-932a-5b0b9f2f622b tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:24.344269 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-03b72a3a-277a-4bbb-932a-5b0b9f2f622b tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:24.378342 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-03b72a3a-277a-4bbb-932a-5b0b9f2f622b tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1266 microversion: 2.1 time: 0.419595 Jun 25 16:06:24.396026 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 11/26] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:23 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1266 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:24.412699 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ac4d8d4c-392f-49b3-844f-4174c4da9c3c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:24.417958 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ac4d8d4c-392f-49b3-844f-4174c4da9c3c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:24.443967 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ac4d8d4c-392f-49b3-844f-4174c4da9c3c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:24.446812 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ac4d8d4c-392f-49b3-844f-4174c4da9c3c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:24.449087 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ac4d8d4c-392f-49b3-844f-4174c4da9c3c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:24.451807 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ac4d8d4c-392f-49b3-844f-4174c4da9c3c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:24.639306 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-d66049da-7f0b-4456-b61b-11a6b32e8049 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Flavor limits 0:0:0 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 16:06:24.641067 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-d66049da-7f0b-4456-b61b-11a6b32e8049 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Image limits 0:0:0 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 16:06:24.641698 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-d66049da-7f0b-4456-b61b-11a6b32e8049 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Flavor pref 0:0:0 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 16:06:24.643368 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-d66049da-7f0b-4456-b61b-11a6b32e8049 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Image pref 0:0:0 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 16:06:24.644876 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-d66049da-7f0b-4456-b61b-11a6b32e8049 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 16:06:24.647002 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ac4d8d4c-392f-49b3-844f-4174c4da9c3c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:24.662661 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ac4d8d4c-392f-49b3-844f-4174c4da9c3c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1217 microversion: 2.1 time: 0.265077 Jun 25 16:06:24.672218 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d66049da-7f0b-4456-b61b-11a6b32e8049 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:24.672761 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d66049da-7f0b-4456-b61b-11a6b32e8049 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:24.673623 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d66049da-7f0b-4456-b61b-11a6b32e8049 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:24.674067 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d66049da-7f0b-4456-b61b-11a6b32e8049 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:24.675618 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 12/27] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:24 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1217 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:24.705444 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.quota [None req-d66049da-7f0b-4456-b61b-11a6b32e8049 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Getting quotas for project b1bba8f74dbd433bbffdb2ffbfc481fb. Resources: {'ram', 'cores', 'instances'} {{(pid=117794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:06:24.712119 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.quota [None req-d66049da-7f0b-4456-b61b-11a6b32e8049 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Getting quotas for user 19140330ae664e45b85f47f321496191 and project b1bba8f74dbd433bbffdb2ffbfc481fb. Resources: {'ram', 'cores', 'instances'} {{(pid=117794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:06:24.727605 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-d66049da-7f0b-4456-b61b-11a6b32e8049 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Going to run 1 instances... {{(pid=117794) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 16:06:24.730144 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-d66049da-7f0b-4456-b61b-11a6b32e8049 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84c164fa-276d-4693-b7a0-24fd3024b359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 16:06:24.799152 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-d66049da-7f0b-4456-b61b-11a6b32e8049 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.959633 Jun 25 16:06:24.799818 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 16/28] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Jun 25 16:06:22 2022] POST /compute/v2.1/servers => generated 402 bytes in 1961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 16:06:24.818643 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-fa258ef0-84d4-45c4-8a6c-b764ed7041ce tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:24.821665 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-fa258ef0-84d4-45c4-8a6c-b764ed7041ce tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:25.021254 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fa258ef0-84d4-45c4-8a6c-b764ed7041ce tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:25.028783 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-fa258ef0-84d4-45c4-8a6c-b764ed7041ce tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1241 microversion: 2.1 time: 0.222551 Jun 25 16:06:25.029372 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 13/29] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:24 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1241 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:25.402284 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-ff5c3bf8-e08e-4173-9995-436e04f7dced tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:25.402980 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-ff5c3bf8-e08e-4173-9995-436e04f7dced tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:25.436296 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ff5c3bf8-e08e-4173-9995-436e04f7dced tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:25.439960 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ff5c3bf8-e08e-4173-9995-436e04f7dced tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:25.444863 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ff5c3bf8-e08e-4173-9995-436e04f7dced tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:25.448193 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ff5c3bf8-e08e-4173-9995-436e04f7dced tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:25.682180 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-beb55f96-8b2f-4b14-835b-a89de359aa84 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:25.683236 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-beb55f96-8b2f-4b14-835b-a89de359aa84 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:25.717113 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-beb55f96-8b2f-4b14-835b-a89de359aa84 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:25.719279 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-beb55f96-8b2f-4b14-835b-a89de359aa84 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:25.720197 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-beb55f96-8b2f-4b14-835b-a89de359aa84 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:25.733942 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-beb55f96-8b2f-4b14-835b-a89de359aa84 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:26.663299 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-beb55f96-8b2f-4b14-835b-a89de359aa84 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:26.687010 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-beb55f96-8b2f-4b14-835b-a89de359aa84 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1279 microversion: 2.1 time: 1.009566 Jun 25 16:06:26.690622 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 14/30] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:25 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1279 bytes in 1014 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:06:26.696623 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-ff5c3bf8-e08e-4173-9995-436e04f7dced tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:26.723052 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-dd3ce86a-26ca-4aff-89ab-205a1382f351 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:26.723687 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-dd3ce86a-26ca-4aff-89ab-205a1382f351 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:26.734407 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-ff5c3bf8-e08e-4173-9995-436e04f7dced tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1272 microversion: 2.1 time: 1.334332 Jun 25 16:06:26.739023 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 17/31] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:25 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1272 bytes in 1344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:26.746415 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dd3ce86a-26ca-4aff-89ab-205a1382f351 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:26.747968 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dd3ce86a-26ca-4aff-89ab-205a1382f351 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:26.750531 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dd3ce86a-26ca-4aff-89ab-205a1382f351 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:26.752477 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dd3ce86a-26ca-4aff-89ab-205a1382f351 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:27.033975 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-dd3ce86a-26ca-4aff-89ab-205a1382f351 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:27.047543 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-dd3ce86a-26ca-4aff-89ab-205a1382f351 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1237 microversion: 2.1 time: 0.355645 Jun 25 16:06:27.050448 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 15/32] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:26 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1237 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:27.707878 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-eed73503-5de3-4a27-b91d-d6a5b3ecebbb tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:27.708530 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-eed73503-5de3-4a27-b91d-d6a5b3ecebbb tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:27.734333 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-eed73503-5de3-4a27-b91d-d6a5b3ecebbb tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:27.736148 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-eed73503-5de3-4a27-b91d-d6a5b3ecebbb tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:27.737552 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-eed73503-5de3-4a27-b91d-d6a5b3ecebbb tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:27.739354 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-eed73503-5de3-4a27-b91d-d6a5b3ecebbb tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:27.756722 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-fcc422d1-2f32-4916-9ce4-e73636112c51 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:27.758320 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-fcc422d1-2f32-4916-9ce4-e73636112c51 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:27.808601 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fcc422d1-2f32-4916-9ce4-e73636112c51 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:27.809066 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fcc422d1-2f32-4916-9ce4-e73636112c51 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:27.809864 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fcc422d1-2f32-4916-9ce4-e73636112c51 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:27.810296 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fcc422d1-2f32-4916-9ce4-e73636112c51 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:28.170515 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-eed73503-5de3-4a27-b91d-d6a5b3ecebbb tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:28.182999 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-eed73503-5de3-4a27-b91d-d6a5b3ecebbb tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1279 microversion: 2.1 time: 0.477054 Jun 25 16:06:28.183623 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 18/33] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:27 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1279 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:28.200628 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-5dfe96ac-f0f4-429d-a698-8e6cbae004ed tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:28.201329 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-5dfe96ac-f0f4-429d-a698-8e6cbae004ed tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:28.234034 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5dfe96ac-f0f4-429d-a698-8e6cbae004ed tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:28.234407 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5dfe96ac-f0f4-429d-a698-8e6cbae004ed tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:28.235214 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5dfe96ac-f0f4-429d-a698-8e6cbae004ed tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:28.235657 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5dfe96ac-f0f4-429d-a698-8e6cbae004ed tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:28.706624 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-5dfe96ac-f0f4-429d-a698-8e6cbae004ed tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:28.718989 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-5dfe96ac-f0f4-429d-a698-8e6cbae004ed tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1311 microversion: 2.1 time: 0.525320 Jun 25 16:06:28.720292 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 19/34] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:28 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1311 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:28.946444 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fcc422d1-2f32-4916-9ce4-e73636112c51 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:28.962671 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-fcc422d1-2f32-4916-9ce4-e73636112c51 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1314 microversion: 2.1 time: 1.205927 Jun 25 16:06:28.964111 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 16/35] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:27 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1314 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:06:29.204706 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-734681e7-4743-482a-9d12-c6ca6d6177a4 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:29.205451 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-734681e7-4743-482a-9d12-c6ca6d6177a4 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:29.219481 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-734681e7-4743-482a-9d12-c6ca6d6177a4 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:29.220199 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-734681e7-4743-482a-9d12-c6ca6d6177a4 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:29.222667 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-734681e7-4743-482a-9d12-c6ca6d6177a4 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:29.224751 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-734681e7-4743-482a-9d12-c6ca6d6177a4 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:29.742153 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-cbf06b78-bf85-45b1-89d9-f2f190ea33b1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:29.743000 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-cbf06b78-bf85-45b1-89d9-f2f190ea33b1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:29.757230 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cbf06b78-bf85-45b1-89d9-f2f190ea33b1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:29.761044 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cbf06b78-bf85-45b1-89d9-f2f190ea33b1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:29.767242 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cbf06b78-bf85-45b1-89d9-f2f190ea33b1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:29.768909 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cbf06b78-bf85-45b1-89d9-f2f190ea33b1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:30.341913 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-cbf06b78-bf85-45b1-89d9-f2f190ea33b1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:30.350665 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-cbf06b78-bf85-45b1-89d9-f2f190ea33b1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1299 microversion: 2.1 time: 0.612795 Jun 25 16:06:30.354354 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 17/36] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:29 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1299 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:30.361525 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-68b36f9f-580c-4775-9f61-6bd9d4fb09f2 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:30.362137 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-68b36f9f-580c-4775-9f61-6bd9d4fb09f2 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:30.384212 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-68b36f9f-580c-4775-9f61-6bd9d4fb09f2 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:30.389483 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-68b36f9f-580c-4775-9f61-6bd9d4fb09f2 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:30.391580 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-68b36f9f-580c-4775-9f61-6bd9d4fb09f2 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:30.392034 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-68b36f9f-580c-4775-9f61-6bd9d4fb09f2 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:30.463757 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-734681e7-4743-482a-9d12-c6ca6d6177a4 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:30.472573 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-734681e7-4743-482a-9d12-c6ca6d6177a4 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1321 microversion: 2.1 time: 1.271884 Jun 25 16:06:30.476721 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 20/37] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:29 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1321 bytes in 1277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:30.685215 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=4 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:06:31.371660 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-3632654e-8836-4206-b4c2-1bff9445a008 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:31.372573 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-3632654e-8836-4206-b4c2-1bff9445a008 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:31.384525 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3632654e-8836-4206-b4c2-1bff9445a008 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:31.391363 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-68b36f9f-580c-4775-9f61-6bd9d4fb09f2 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:31.396996 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3632654e-8836-4206-b4c2-1bff9445a008 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:31.403404 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3632654e-8836-4206-b4c2-1bff9445a008 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:31.406925 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3632654e-8836-4206-b4c2-1bff9445a008 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:31.409082 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-68b36f9f-580c-4775-9f61-6bd9d4fb09f2 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1314 microversion: 2.1 time: 1.051102 Jun 25 16:06:31.421744 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 18/38] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:30 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1314 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:31.492961 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9ab52a4a-8fbf-4719-8270-39c668292b30 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:31.493699 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9ab52a4a-8fbf-4719-8270-39c668292b30 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:31.504973 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9ab52a4a-8fbf-4719-8270-39c668292b30 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:31.509109 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9ab52a4a-8fbf-4719-8270-39c668292b30 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:31.512294 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9ab52a4a-8fbf-4719-8270-39c668292b30 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:31.514535 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9ab52a4a-8fbf-4719-8270-39c668292b30 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:31.629154 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-3632654e-8836-4206-b4c2-1bff9445a008 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:31.638774 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-3632654e-8836-4206-b4c2-1bff9445a008 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1299 microversion: 2.1 time: 0.271045 Jun 25 16:06:31.651769 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 21/39] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:31 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1299 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:32.430755 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-9a2610aa-6868-4b98-ba04-128a7ba9f077 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:32.434183 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-9a2610aa-6868-4b98-ba04-128a7ba9f077 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:32.483585 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9a2610aa-6868-4b98-ba04-128a7ba9f077 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:32.491804 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9a2610aa-6868-4b98-ba04-128a7ba9f077 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:32.493692 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9a2610aa-6868-4b98-ba04-128a7ba9f077 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:32.498402 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9a2610aa-6868-4b98-ba04-128a7ba9f077 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:33.348569 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9ab52a4a-8fbf-4719-8270-39c668292b30 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:33.374830 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9ab52a4a-8fbf-4719-8270-39c668292b30 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1321 microversion: 2.1 time: 1.885215 Jun 25 16:06:33.377784 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 19/40] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:31 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1321 bytes in 1890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:06:33.403847 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ddb2a69d-3514-45bc-b269-ea146f158015 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:33.411295 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ddb2a69d-3514-45bc-b269-ea146f158015 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:33.441710 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ddb2a69d-3514-45bc-b269-ea146f158015 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:33.442177 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ddb2a69d-3514-45bc-b269-ea146f158015 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:33.443811 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ddb2a69d-3514-45bc-b269-ea146f158015 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:33.444260 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ddb2a69d-3514-45bc-b269-ea146f158015 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:33.521936 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-9a2610aa-6868-4b98-ba04-128a7ba9f077 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:33.531826 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-9a2610aa-6868-4b98-ba04-128a7ba9f077 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1314 microversion: 2.1 time: 1.105408 Jun 25 16:06:33.536955 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 22/41] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:32 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1314 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:06:33.694152 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-7dfb10a0-7bca-4ed8-aba3-d67c84711a79 req-d27bad82-9b8e-4234-8b00-52a3b2ee7e7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01f7cc79-f68f-4fe1-b31e-1cb4f0fea810", "tag": "da56dc06-e8a5-4eac-a9b3-a873439d682c"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:06:33.732325 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-7dfb10a0-7bca-4ed8-aba3-d67c84711a79 req-d27bad82-9b8e-4234-8b00-52a3b2ee7e7e service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:33.740163 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-7dfb10a0-7bca-4ed8-aba3-d67c84711a79 req-d27bad82-9b8e-4234-8b00-52a3b2ee7e7e service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:33.794091 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-7dfb10a0-7bca-4ed8-aba3-d67c84711a79 req-d27bad82-9b8e-4234-8b00-52a3b2ee7e7e service nova] Creating event network-changed:da56dc06-e8a5-4eac-a9b3-a873439d682c for instance 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 on hv-cinder-84762 Jun 25 16:06:33.796772 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-7dfb10a0-7bca-4ed8-aba3-d67c84711a79 req-d27bad82-9b8e-4234-8b00-52a3b2ee7e7e service nova] Acquired lock "compute-rpcapi-router" {{(pid=117794) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 25 16:06:33.802016 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-49260ad2-1ab8-49db-98f7-7274d5ec5635 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:33.803763 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ddb2a69d-3514-45bc-b269-ea146f158015 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:33.804195 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-49260ad2-1ab8-49db-98f7-7274d5ec5635 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:33.806564 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-49260ad2-1ab8-49db-98f7-7274d5ec5635 None None] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:33.809688 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-49260ad2-1ab8-49db-98f7-7274d5ec5635 None None] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:33.831716 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.compute.rpcapi [None req-49260ad2-1ab8-49db-98f7-7274d5ec5635 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 25 16:06:33.832888 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-49260ad2-1ab8-49db-98f7-7274d5ec5635 None None] Releasing lock "compute-rpcapi-router" {{(pid=117794) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 25 16:06:33.880024 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-49260ad2-1ab8-49db-98f7-7274d5ec5635 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.341457 Jun 25 16:06:33.881048 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 23/42] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:06:33.887261 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ddb2a69d-3514-45bc-b269-ea146f158015 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1367 microversion: 2.1 time: 0.508374 Jun 25 16:06:33.893807 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 20/43] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:33 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1367 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:33.991051 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-4568d6dc-69d1-4bc1-b473-9f564ac9dad5 req-194c2382-72d0-4536-8a27-195117b115df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7feaccc2-e2e8-4644-87a9-4b88cd8767d5", "tag": "dda3a175-359c-4380-a748-ac6e5ec45c69"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:06:34.002916 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-4568d6dc-69d1-4bc1-b473-9f564ac9dad5 req-194c2382-72d0-4536-8a27-195117b115df service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:34.003409 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-4568d6dc-69d1-4bc1-b473-9f564ac9dad5 req-194c2382-72d0-4536-8a27-195117b115df service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:34.017345 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-4568d6dc-69d1-4bc1-b473-9f564ac9dad5 req-194c2382-72d0-4536-8a27-195117b115df service nova] Creating event network-changed:dda3a175-359c-4380-a748-ac6e5ec45c69 for instance 7feaccc2-e2e8-4644-87a9-4b88cd8767d5 on hv-cinder-84762 Jun 25 16:06:34.022969 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-4568d6dc-69d1-4bc1-b473-9f564ac9dad5 req-194c2382-72d0-4536-8a27-195117b115df service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.140471 Jun 25 16:06:34.023794 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 24/44] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:06:34.396353 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c0d45c90-e1b5-4612-b775-a3b4384e2c54 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:34.397071 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c0d45c90-e1b5-4612-b775-a3b4384e2c54 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:34.409239 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c0d45c90-e1b5-4612-b775-a3b4384e2c54 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:34.409702 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c0d45c90-e1b5-4612-b775-a3b4384e2c54 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:34.410536 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c0d45c90-e1b5-4612-b775-a3b4384e2c54 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:34.410978 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c0d45c90-e1b5-4612-b775-a3b4384e2c54 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:34.563289 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-dc0b217b-78ad-4608-9615-7ddd5c839381 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:34.564009 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-dc0b217b-78ad-4608-9615-7ddd5c839381 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:34.575624 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-dc0b217b-78ad-4608-9615-7ddd5c839381 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:34.577810 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-dc0b217b-78ad-4608-9615-7ddd5c839381 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:34.578794 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-dc0b217b-78ad-4608-9615-7ddd5c839381 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:34.579410 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-dc0b217b-78ad-4608-9615-7ddd5c839381 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:34.675063 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c0d45c90-e1b5-4612-b775-a3b4384e2c54 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:34.695038 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c0d45c90-e1b5-4612-b775-a3b4384e2c54 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1321 microversion: 2.1 time: 0.303473 Jun 25 16:06:34.708532 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 21/45] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:34 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1321 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:34.723386 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell0:SELECT=14 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:06:34.789653 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-dc0b217b-78ad-4608-9615-7ddd5c839381 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:34.798755 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-dc0b217b-78ad-4608-9615-7ddd5c839381 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1314 microversion: 2.1 time: 0.239940 Jun 25 16:06:34.800949 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 25/46] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:34 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:06:34.910073 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-0ecbf5bd-0965-428b-b90f-c696400f598f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:34.911896 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0ecbf5bd-0965-428b-b90f-c696400f598f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:34.929318 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0ecbf5bd-0965-428b-b90f-c696400f598f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:34.930309 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0ecbf5bd-0965-428b-b90f-c696400f598f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:34.931297 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0ecbf5bd-0965-428b-b90f-c696400f598f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:34.933968 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0ecbf5bd-0965-428b-b90f-c696400f598f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:35.028737 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=24 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:06:35.185872 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-0ecbf5bd-0965-428b-b90f-c696400f598f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:35.193862 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-0ecbf5bd-0965-428b-b90f-c696400f598f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1367 microversion: 2.1 time: 0.288849 Jun 25 16:06:35.195092 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 22/47] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:34 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1367 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:35.715572 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-e16b5716-7fd0-4a8c-8d61-0ee702bbb02e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:35.716864 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-e16b5716-7fd0-4a8c-8d61-0ee702bbb02e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:35.723443 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e16b5716-7fd0-4a8c-8d61-0ee702bbb02e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:35.724091 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e16b5716-7fd0-4a8c-8d61-0ee702bbb02e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:35.725047 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e16b5716-7fd0-4a8c-8d61-0ee702bbb02e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:35.725495 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e16b5716-7fd0-4a8c-8d61-0ee702bbb02e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:35.820971 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-104cdb46-5e82-4b82-8954-2d7577a48533 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:35.822351 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-104cdb46-5e82-4b82-8954-2d7577a48533 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:35.829218 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-104cdb46-5e82-4b82-8954-2d7577a48533 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:35.830020 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-104cdb46-5e82-4b82-8954-2d7577a48533 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:35.830992 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-104cdb46-5e82-4b82-8954-2d7577a48533 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:35.831660 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-104cdb46-5e82-4b82-8954-2d7577a48533 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:36.141131 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-e16b5716-7fd0-4a8c-8d61-0ee702bbb02e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:36.152656 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-e16b5716-7fd0-4a8c-8d61-0ee702bbb02e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1321 microversion: 2.1 time: 0.441149 Jun 25 16:06:36.163540 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 26/48] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:35 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1321 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:36.171823 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-56101a49-2ad2-47ee-ad64-fc5273b93505 req-5b1776a6-f141-4291-a23b-dae390084ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dc4f0bb-0b30-429c-af92-a30f31e4b60f", "tag": "da8ae9de-1432-4b4c-9379-90aae9bf04a3"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:06:36.187781 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-56101a49-2ad2-47ee-ad64-fc5273b93505 req-5b1776a6-f141-4291-a23b-dae390084ce2 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:36.189112 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-56101a49-2ad2-47ee-ad64-fc5273b93505 req-5b1776a6-f141-4291-a23b-dae390084ce2 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:36.214550 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-56101a49-2ad2-47ee-ad64-fc5273b93505 req-5b1776a6-f141-4291-a23b-dae390084ce2 service nova] Creating event network-changed:da8ae9de-1432-4b4c-9379-90aae9bf04a3 for instance 9dc4f0bb-0b30-429c-af92-a30f31e4b60f on hv-cinder-84762 Jun 25 16:06:36.220835 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-56101a49-2ad2-47ee-ad64-fc5273b93505 req-5b1776a6-f141-4291-a23b-dae390084ce2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055932 Jun 25 16:06:36.221790 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 27/49] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:06:36.228535 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-08dbdc98-a4a6-4333-956e-2c2012f60daa req-a4650ff1-7d85-4ab0-86c8-a831065df7b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5f6023f-52bc-4a18-af15-b1c7f2896f75", "tag": "e355ac8e-fb57-4cd6-9b51-2346658384b8"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:06:36.238999 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-104cdb46-5e82-4b82-8954-2d7577a48533 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:36.252665 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-08dbdc98-a4a6-4333-956e-2c2012f60daa req-a4650ff1-7d85-4ab0-86c8-a831065df7b4 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:36.254627 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-08dbdc98-a4a6-4333-956e-2c2012f60daa req-a4650ff1-7d85-4ab0-86c8-a831065df7b4 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:36.267569 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-104cdb46-5e82-4b82-8954-2d7577a48533 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1314 microversion: 2.1 time: 0.447705 Jun 25 16:06:36.268581 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 23/50] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:35 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:36.287537 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-afb59207-c712-438b-a08d-f264fbb146c8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:36.288517 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-afb59207-c712-438b-a08d-f264fbb146c8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:36.291297 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-08dbdc98-a4a6-4333-956e-2c2012f60daa req-a4650ff1-7d85-4ab0-86c8-a831065df7b4 service nova] Creating event network-changed:e355ac8e-fb57-4cd6-9b51-2346658384b8 for instance f5f6023f-52bc-4a18-af15-b1c7f2896f75 on hv-cinder-84762 Jun 25 16:06:36.299273 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-08dbdc98-a4a6-4333-956e-2c2012f60daa req-a4650ff1-7d85-4ab0-86c8-a831065df7b4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075774 Jun 25 16:06:36.300750 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 28/51] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:06:36.305885 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-afb59207-c712-438b-a08d-f264fbb146c8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:36.306540 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-afb59207-c712-438b-a08d-f264fbb146c8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:36.307364 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-afb59207-c712-438b-a08d-f264fbb146c8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:36.307914 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-afb59207-c712-438b-a08d-f264fbb146c8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:36.532317 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-afb59207-c712-438b-a08d-f264fbb146c8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:36.584224 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-afb59207-c712-438b-a08d-f264fbb146c8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1367 microversion: 2.1 time: 0.307840 Jun 25 16:06:36.587618 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 24/52] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:36 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1367 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:37.176893 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-0c7cedd4-24c5-4af1-95d8-3d94f2834f05 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:37.178841 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-0c7cedd4-24c5-4af1-95d8-3d94f2834f05 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:37.185992 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=6 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:06:37.188133 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0c7cedd4-24c5-4af1-95d8-3d94f2834f05 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:37.188781 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0c7cedd4-24c5-4af1-95d8-3d94f2834f05 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:37.190076 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0c7cedd4-24c5-4af1-95d8-3d94f2834f05 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:37.190770 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0c7cedd4-24c5-4af1-95d8-3d94f2834f05 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:37.284258 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-085e499f-437c-4b1a-a651-47378aa942f7 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:37.285569 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-085e499f-437c-4b1a-a651-47378aa942f7 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:37.308803 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-085e499f-437c-4b1a-a651-47378aa942f7 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:37.319281 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-085e499f-437c-4b1a-a651-47378aa942f7 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:37.320342 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-085e499f-437c-4b1a-a651-47378aa942f7 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:37.320816 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-085e499f-437c-4b1a-a651-47378aa942f7 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:37.475044 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-0c7cedd4-24c5-4af1-95d8-3d94f2834f05 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:37.496705 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-0c7cedd4-24c5-4af1-95d8-3d94f2834f05 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1321 microversion: 2.1 time: 0.324735 Jun 25 16:06:37.498737 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 29/53] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:37 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1321 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:37.605812 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-5a43c3f4-0e07-4d11-960d-2319bcbff04b tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:37.606698 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-5a43c3f4-0e07-4d11-960d-2319bcbff04b tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:37.617851 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-085e499f-437c-4b1a-a651-47378aa942f7 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:37.620299 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5a43c3f4-0e07-4d11-960d-2319bcbff04b tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:37.620967 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5a43c3f4-0e07-4d11-960d-2319bcbff04b tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:37.623727 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5a43c3f4-0e07-4d11-960d-2319bcbff04b tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:37.624949 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5a43c3f4-0e07-4d11-960d-2319bcbff04b tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:37.626895 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-085e499f-437c-4b1a-a651-47378aa942f7 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1314 microversion: 2.1 time: 0.346312 Jun 25 16:06:37.631025 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 25/54] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:37 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1314 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:06:37.841807 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-5a43c3f4-0e07-4d11-960d-2319bcbff04b tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:37.856051 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-5a43c3f4-0e07-4d11-960d-2319bcbff04b tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1367 microversion: 2.1 time: 0.255212 Jun 25 16:06:37.876707 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 30/55] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:37 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:06:38.517961 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7766a975-c04d-417e-989a-db0eb5b18d22 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:38.518605 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7766a975-c04d-417e-989a-db0eb5b18d22 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:38.527183 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7766a975-c04d-417e-989a-db0eb5b18d22 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:38.527647 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7766a975-c04d-417e-989a-db0eb5b18d22 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:38.529100 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7766a975-c04d-417e-989a-db0eb5b18d22 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:38.529539 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7766a975-c04d-417e-989a-db0eb5b18d22 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:38.643811 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-e3ff0d41-4646-4786-86b6-b8c09e4afb35 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:38.644437 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-e3ff0d41-4646-4786-86b6-b8c09e4afb35 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:38.650893 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e3ff0d41-4646-4786-86b6-b8c09e4afb35 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:38.651379 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e3ff0d41-4646-4786-86b6-b8c09e4afb35 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:38.652160 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e3ff0d41-4646-4786-86b6-b8c09e4afb35 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:38.652609 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e3ff0d41-4646-4786-86b6-b8c09e4afb35 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:38.681715 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7766a975-c04d-417e-989a-db0eb5b18d22 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:38.691913 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7766a975-c04d-417e-989a-db0eb5b18d22 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1321 microversion: 2.1 time: 0.178319 Jun 25 16:06:38.693303 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 26/56] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:38 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1321 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:38.796482 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-e3ff0d41-4646-4786-86b6-b8c09e4afb35 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:38.803521 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-e3ff0d41-4646-4786-86b6-b8c09e4afb35 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1314 microversion: 2.1 time: 0.164078 Jun 25 16:06:38.804119 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 31/57] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:38 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:38.875147 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b8769f50-4156-42c9-a936-0a88cc253e00 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:38.875837 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b8769f50-4156-42c9-a936-0a88cc253e00 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:38.882449 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b8769f50-4156-42c9-a936-0a88cc253e00 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:38.882981 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b8769f50-4156-42c9-a936-0a88cc253e00 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:38.883791 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b8769f50-4156-42c9-a936-0a88cc253e00 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:38.884215 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b8769f50-4156-42c9-a936-0a88cc253e00 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:39.201997 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b8769f50-4156-42c9-a936-0a88cc253e00 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:39.206077 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=100 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:06:39.214872 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b8769f50-4156-42c9-a936-0a88cc253e00 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1367 microversion: 2.1 time: 0.342631 Jun 25 16:06:39.215680 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 27/58] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:38 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1367 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:39.711875 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-b18d7207-e71f-4c83-9c47-bb88ebe5eebb tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:39.712566 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-b18d7207-e71f-4c83-9c47-bb88ebe5eebb tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:39.720137 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b18d7207-e71f-4c83-9c47-bb88ebe5eebb tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:39.721282 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b18d7207-e71f-4c83-9c47-bb88ebe5eebb tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:39.722131 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b18d7207-e71f-4c83-9c47-bb88ebe5eebb tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:39.722671 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b18d7207-e71f-4c83-9c47-bb88ebe5eebb tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:39.821310 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-48dbe64e-aab1-44fc-8727-0300530d0a3f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:39.822027 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-48dbe64e-aab1-44fc-8727-0300530d0a3f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:39.828792 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-48dbe64e-aab1-44fc-8727-0300530d0a3f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:39.829208 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-48dbe64e-aab1-44fc-8727-0300530d0a3f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:39.829978 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-48dbe64e-aab1-44fc-8727-0300530d0a3f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:39.830415 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-48dbe64e-aab1-44fc-8727-0300530d0a3f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:39.900503 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-b18d7207-e71f-4c83-9c47-bb88ebe5eebb tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:39.911766 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-b18d7207-e71f-4c83-9c47-bb88ebe5eebb tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1321 microversion: 2.1 time: 0.206354 Jun 25 16:06:39.913094 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 32/59] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:39 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:39.993511 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-48dbe64e-aab1-44fc-8727-0300530d0a3f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:40.002751 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-48dbe64e-aab1-44fc-8727-0300530d0a3f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1314 microversion: 2.1 time: 0.185863 Jun 25 16:06:40.003344 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 28/60] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:39 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:06:40.234445 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-33ff1537-c696-4e0d-a485-b2b625546e26 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:40.235055 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-33ff1537-c696-4e0d-a485-b2b625546e26 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:40.241362 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-33ff1537-c696-4e0d-a485-b2b625546e26 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:40.241976 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-33ff1537-c696-4e0d-a485-b2b625546e26 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:40.242840 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-33ff1537-c696-4e0d-a485-b2b625546e26 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:40.243442 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-33ff1537-c696-4e0d-a485-b2b625546e26 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:40.385460 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-33ff1537-c696-4e0d-a485-b2b625546e26 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:40.393863 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-33ff1537-c696-4e0d-a485-b2b625546e26 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1367 microversion: 2.1 time: 0.164107 Jun 25 16:06:40.394446 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 33/61] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:40 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:40.930245 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a6a6f439-0ba2-4b9a-8e77-d19f5bf673a4 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:40.930962 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a6a6f439-0ba2-4b9a-8e77-d19f5bf673a4 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:40.937973 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a6a6f439-0ba2-4b9a-8e77-d19f5bf673a4 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:40.938416 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a6a6f439-0ba2-4b9a-8e77-d19f5bf673a4 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:40.939175 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a6a6f439-0ba2-4b9a-8e77-d19f5bf673a4 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:40.939605 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a6a6f439-0ba2-4b9a-8e77-d19f5bf673a4 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:41.023082 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-d88c6771-5198-4e7f-a95d-5629c3ba4bc2 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:41.023725 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-d88c6771-5198-4e7f-a95d-5629c3ba4bc2 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:41.030648 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d88c6771-5198-4e7f-a95d-5629c3ba4bc2 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:41.031177 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d88c6771-5198-4e7f-a95d-5629c3ba4bc2 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:41.032041 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d88c6771-5198-4e7f-a95d-5629c3ba4bc2 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:41.032551 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d88c6771-5198-4e7f-a95d-5629c3ba4bc2 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:41.112466 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a6a6f439-0ba2-4b9a-8e77-d19f5bf673a4 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:41.120207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a6a6f439-0ba2-4b9a-8e77-d19f5bf673a4 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1321 microversion: 2.1 time: 0.194632 Jun 25 16:06:41.120812 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 29/62] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:40 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:41.184772 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d88c6771-5198-4e7f-a95d-5629c3ba4bc2 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:41.192559 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-d88c6771-5198-4e7f-a95d-5629c3ba4bc2 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1314 microversion: 2.1 time: 0.173530 Jun 25 16:06:41.193119 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 34/63] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:41 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:41.412673 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-99575756-e738-439d-9b69-24ca052e751a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:41.413298 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-99575756-e738-439d-9b69-24ca052e751a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:41.415347 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:06:41.420964 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-99575756-e738-439d-9b69-24ca052e751a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:41.421408 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-99575756-e738-439d-9b69-24ca052e751a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:41.422222 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-99575756-e738-439d-9b69-24ca052e751a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:41.422646 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-99575756-e738-439d-9b69-24ca052e751a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:41.559744 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-99575756-e738-439d-9b69-24ca052e751a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:41.567485 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-99575756-e738-439d-9b69-24ca052e751a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1367 microversion: 2.1 time: 0.159061 Jun 25 16:06:41.568109 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 30/64] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:41 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:42.141714 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-d12785a1-505e-4347-98dd-bd19eb129398 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:42.142919 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-d12785a1-505e-4347-98dd-bd19eb129398 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:42.150687 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d12785a1-505e-4347-98dd-bd19eb129398 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:42.151134 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d12785a1-505e-4347-98dd-bd19eb129398 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:42.151897 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d12785a1-505e-4347-98dd-bd19eb129398 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:42.152333 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d12785a1-505e-4347-98dd-bd19eb129398 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:42.156372 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=100 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:06:42.209783 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-eabad424-4ce9-45df-aa5d-aca4b2bfce13 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:42.210557 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-eabad424-4ce9-45df-aa5d-aca4b2bfce13 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:42.217101 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-eabad424-4ce9-45df-aa5d-aca4b2bfce13 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:42.217528 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-eabad424-4ce9-45df-aa5d-aca4b2bfce13 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:42.218325 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-eabad424-4ce9-45df-aa5d-aca4b2bfce13 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:42.218762 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-eabad424-4ce9-45df-aa5d-aca4b2bfce13 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:42.324963 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d12785a1-505e-4347-98dd-bd19eb129398 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:42.333841 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-d12785a1-505e-4347-98dd-bd19eb129398 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1321 microversion: 2.1 time: 0.197942 Jun 25 16:06:42.334406 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 35/65] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:42 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:42.370975 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-eabad424-4ce9-45df-aa5d-aca4b2bfce13 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:42.380507 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-eabad424-4ce9-45df-aa5d-aca4b2bfce13 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1314 microversion: 2.1 time: 0.174511 Jun 25 16:06:42.381226 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 31/66] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:42 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:42.584430 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-de2cd6df-369b-4057-a0d7-d07e769aa516 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:42.585040 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-de2cd6df-369b-4057-a0d7-d07e769aa516 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:42.591356 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-de2cd6df-369b-4057-a0d7-d07e769aa516 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:42.591678 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-de2cd6df-369b-4057-a0d7-d07e769aa516 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:42.592524 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-de2cd6df-369b-4057-a0d7-d07e769aa516 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:42.592963 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-de2cd6df-369b-4057-a0d7-d07e769aa516 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:42.746594 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-de2cd6df-369b-4057-a0d7-d07e769aa516 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:42.754200 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-de2cd6df-369b-4057-a0d7-d07e769aa516 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1367 microversion: 2.1 time: 0.173619 Jun 25 16:06:42.754766 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 36/67] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:42 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:43.354436 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c0018f84-dec9-486e-8908-1ad525c04378 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:43.355124 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c0018f84-dec9-486e-8908-1ad525c04378 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:43.363026 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c0018f84-dec9-486e-8908-1ad525c04378 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:43.363502 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c0018f84-dec9-486e-8908-1ad525c04378 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:43.364521 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c0018f84-dec9-486e-8908-1ad525c04378 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:43.365088 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c0018f84-dec9-486e-8908-1ad525c04378 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:43.398620 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-2617f264-5e94-4f2a-83f4-e55bd604e1c8 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:43.399321 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-2617f264-5e94-4f2a-83f4-e55bd604e1c8 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:43.405535 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2617f264-5e94-4f2a-83f4-e55bd604e1c8 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:43.405991 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2617f264-5e94-4f2a-83f4-e55bd604e1c8 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:43.406794 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2617f264-5e94-4f2a-83f4-e55bd604e1c8 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:43.407228 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2617f264-5e94-4f2a-83f4-e55bd604e1c8 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:43.551006 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c0018f84-dec9-486e-8908-1ad525c04378 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:43.558519 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c0018f84-dec9-486e-8908-1ad525c04378 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1321 microversion: 2.1 time: 0.210914 Jun 25 16:06:43.559272 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 32/68] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:43 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:43.577943 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-2617f264-5e94-4f2a-83f4-e55bd604e1c8 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:43.585716 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-2617f264-5e94-4f2a-83f4-e55bd604e1c8 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1314 microversion: 2.1 time: 0.191057 Jun 25 16:06:43.586279 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 37/69] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:43 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:43.774221 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5b93e35d-747b-4363-b6ca-d04d2a664b26 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:43.774725 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5b93e35d-747b-4363-b6ca-d04d2a664b26 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:43.781143 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5b93e35d-747b-4363-b6ca-d04d2a664b26 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:43.781591 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5b93e35d-747b-4363-b6ca-d04d2a664b26 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:43.782350 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5b93e35d-747b-4363-b6ca-d04d2a664b26 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:43.782779 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5b93e35d-747b-4363-b6ca-d04d2a664b26 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:43.916070 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-5b93e35d-747b-4363-b6ca-d04d2a664b26 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:43.923725 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5b93e35d-747b-4363-b6ca-d04d2a664b26 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1367 microversion: 2.1 time: 0.153771 Jun 25 16:06:43.924336 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 33/70] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:43 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:44.575206 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-d85a9669-31d8-42bc-9de6-cb3fd8c6c4ed tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:44.575887 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-d85a9669-31d8-42bc-9de6-cb3fd8c6c4ed tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:44.577779 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell0:SELECT=6 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:06:44.583188 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d85a9669-31d8-42bc-9de6-cb3fd8c6c4ed tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:44.583648 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d85a9669-31d8-42bc-9de6-cb3fd8c6c4ed tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:44.584444 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d85a9669-31d8-42bc-9de6-cb3fd8c6c4ed tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:44.584890 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d85a9669-31d8-42bc-9de6-cb3fd8c6c4ed tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:44.607151 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f33bafef-99b7-4545-8ffa-c2ccf0c69221 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:44.607780 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f33bafef-99b7-4545-8ffa-c2ccf0c69221 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:44.614145 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f33bafef-99b7-4545-8ffa-c2ccf0c69221 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:44.614591 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f33bafef-99b7-4545-8ffa-c2ccf0c69221 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:44.615349 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f33bafef-99b7-4545-8ffa-c2ccf0c69221 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:44.615779 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f33bafef-99b7-4545-8ffa-c2ccf0c69221 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:44.780646 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d85a9669-31d8-42bc-9de6-cb3fd8c6c4ed tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:44.788786 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-d85a9669-31d8-42bc-9de6-cb3fd8c6c4ed tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1321 microversion: 2.1 time: 0.217421 Jun 25 16:06:44.789516 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 38/71] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:44 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:44.802673 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f33bafef-99b7-4545-8ffa-c2ccf0c69221 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:44.811099 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f33bafef-99b7-4545-8ffa-c2ccf0c69221 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1314 microversion: 2.1 time: 0.207785 Jun 25 16:06:44.811683 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 34/72] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:44 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:06:44.941632 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-194bd42b-e902-4187-9bdd-9e189773f740 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:44.942234 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-194bd42b-e902-4187-9bdd-9e189773f740 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:44.948823 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-194bd42b-e902-4187-9bdd-9e189773f740 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:44.949448 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-194bd42b-e902-4187-9bdd-9e189773f740 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:44.950208 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-194bd42b-e902-4187-9bdd-9e189773f740 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:44.950664 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-194bd42b-e902-4187-9bdd-9e189773f740 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:45.082818 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-194bd42b-e902-4187-9bdd-9e189773f740 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:45.090795 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-194bd42b-e902-4187-9bdd-9e189773f740 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1367 microversion: 2.1 time: 0.153206 Jun 25 16:06:45.091332 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 39/73] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:44 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:45.809291 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-09408d7d-2147-4a6b-9b0c-314c031b40dd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:45.810624 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-09408d7d-2147-4a6b-9b0c-314c031b40dd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:45.818532 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-09408d7d-2147-4a6b-9b0c-314c031b40dd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:45.819208 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-09408d7d-2147-4a6b-9b0c-314c031b40dd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:45.820597 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-09408d7d-2147-4a6b-9b0c-314c031b40dd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:45.821229 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-09408d7d-2147-4a6b-9b0c-314c031b40dd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:45.827885 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-dfb24a67-efac-4928-8107-80476ee5f5b7 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:45.828528 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-dfb24a67-efac-4928-8107-80476ee5f5b7 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:45.835838 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-dfb24a67-efac-4928-8107-80476ee5f5b7 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:45.836291 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-dfb24a67-efac-4928-8107-80476ee5f5b7 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:45.846500 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-dfb24a67-efac-4928-8107-80476ee5f5b7 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:45.850290 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-dfb24a67-efac-4928-8107-80476ee5f5b7 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:46.162928 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-09408d7d-2147-4a6b-9b0c-314c031b40dd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:46.176046 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-09408d7d-2147-4a6b-9b0c-314c031b40dd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1321 microversion: 2.1 time: 0.370476 Jun 25 16:06:46.176983 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 35/74] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:45 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1321 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:46.181909 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a164716c-e8a1-4268-8fba-22c5022531f0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:46.182964 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a164716c-e8a1-4268-8fba-22c5022531f0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:46.189401 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a164716c-e8a1-4268-8fba-22c5022531f0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:46.190142 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a164716c-e8a1-4268-8fba-22c5022531f0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:46.191132 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a164716c-e8a1-4268-8fba-22c5022531f0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:46.191766 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a164716c-e8a1-4268-8fba-22c5022531f0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:46.198374 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-dfb24a67-efac-4928-8107-80476ee5f5b7 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:46.211873 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-dfb24a67-efac-4928-8107-80476ee5f5b7 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1314 microversion: 2.1 time: 0.388139 Jun 25 16:06:46.212486 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 40/75] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:45 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:46.352828 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a164716c-e8a1-4268-8fba-22c5022531f0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:46.360669 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a164716c-e8a1-4268-8fba-22c5022531f0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1367 microversion: 2.1 time: 0.182311 Jun 25 16:06:46.370763 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 36/76] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:46 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:47.195170 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-640eddcf-7a43-4515-be29-fa85ce033131 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:47.195777 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-640eddcf-7a43-4515-be29-fa85ce033131 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:47.202385 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-640eddcf-7a43-4515-be29-fa85ce033131 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:47.202844 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-640eddcf-7a43-4515-be29-fa85ce033131 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:47.203596 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-640eddcf-7a43-4515-be29-fa85ce033131 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:47.204030 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-640eddcf-7a43-4515-be29-fa85ce033131 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:47.232616 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1ed6b490-bfce-4523-b7aa-9d4125603d58 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:47.233572 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1ed6b490-bfce-4523-b7aa-9d4125603d58 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:47.239976 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1ed6b490-bfce-4523-b7aa-9d4125603d58 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:47.240744 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1ed6b490-bfce-4523-b7aa-9d4125603d58 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:47.241826 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1ed6b490-bfce-4523-b7aa-9d4125603d58 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:47.242470 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1ed6b490-bfce-4523-b7aa-9d4125603d58 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:47.398008 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-640eddcf-7a43-4515-be29-fa85ce033131 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:47.406416 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-640eddcf-7a43-4515-be29-fa85ce033131 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1321 microversion: 2.1 time: 0.215208 Jun 25 16:06:47.407240 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 41/77] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:47 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:47.411999 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-2b487db1-cf61-4efd-a628-17bffa284466 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:47.412704 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-2b487db1-cf61-4efd-a628-17bffa284466 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:47.419334 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2b487db1-cf61-4efd-a628-17bffa284466 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:47.419908 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2b487db1-cf61-4efd-a628-17bffa284466 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:47.420719 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2b487db1-cf61-4efd-a628-17bffa284466 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:47.421206 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2b487db1-cf61-4efd-a628-17bffa284466 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:47.431601 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1ed6b490-bfce-4523-b7aa-9d4125603d58 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:47.440748 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1ed6b490-bfce-4523-b7aa-9d4125603d58 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1314 microversion: 2.1 time: 0.211494 Jun 25 16:06:47.441724 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 37/78] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:47 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:47.551197 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-2b487db1-cf61-4efd-a628-17bffa284466 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:47.561344 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-2b487db1-cf61-4efd-a628-17bffa284466 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1367 microversion: 2.1 time: 0.152878 Jun 25 16:06:47.561917 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 42/79] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:47 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:48.423965 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-99e1b874-3d69-4559-878b-9fac6719ef30 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:48.424655 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-99e1b874-3d69-4559-878b-9fac6719ef30 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:48.431676 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-99e1b874-3d69-4559-878b-9fac6719ef30 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:48.432100 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-99e1b874-3d69-4559-878b-9fac6719ef30 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:48.432876 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-99e1b874-3d69-4559-878b-9fac6719ef30 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:48.433513 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-99e1b874-3d69-4559-878b-9fac6719ef30 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:48.458720 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-21d980e1-edb4-41b2-892c-db441c5f2f75 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:48.460828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-21d980e1-edb4-41b2-892c-db441c5f2f75 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:48.467157 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-21d980e1-edb4-41b2-892c-db441c5f2f75 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:48.467924 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-21d980e1-edb4-41b2-892c-db441c5f2f75 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:48.468961 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-21d980e1-edb4-41b2-892c-db441c5f2f75 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:48.469789 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-21d980e1-edb4-41b2-892c-db441c5f2f75 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:48.665441 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-99e1b874-3d69-4559-878b-9fac6719ef30 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:48.674082 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-99e1b874-3d69-4559-878b-9fac6719ef30 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1321 microversion: 2.1 time: 0.253999 Jun 25 16:06:48.684314 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 38/80] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:48 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1321 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:06:48.689716 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-10446acc-2409-49b0-9c9c-4c6c7809b6e1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:48.690453 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-10446acc-2409-49b0-9c9c-4c6c7809b6e1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:48.696586 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-21d980e1-edb4-41b2-892c-db441c5f2f75 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:48.697144 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-10446acc-2409-49b0-9c9c-4c6c7809b6e1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:48.697580 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-10446acc-2409-49b0-9c9c-4c6c7809b6e1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:48.698799 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-10446acc-2409-49b0-9c9c-4c6c7809b6e1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:48.699310 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-10446acc-2409-49b0-9c9c-4c6c7809b6e1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:48.704706 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-21d980e1-edb4-41b2-892c-db441c5f2f75 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1314 microversion: 2.1 time: 0.249667 Jun 25 16:06:48.705288 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 43/81] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:48 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1314 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:48.896402 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-10446acc-2409-49b0-9c9c-4c6c7809b6e1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:48.906193 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-10446acc-2409-49b0-9c9c-4c6c7809b6e1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1367 microversion: 2.1 time: 0.220328 Jun 25 16:06:48.906976 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 39/82] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:48 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1367 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:49.692225 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-a972429c-9dc6-434b-8aaf-650b85a25898 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:49.692896 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-a972429c-9dc6-434b-8aaf-650b85a25898 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:49.704313 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a972429c-9dc6-434b-8aaf-650b85a25898 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:49.705440 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a972429c-9dc6-434b-8aaf-650b85a25898 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:49.705573 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a972429c-9dc6-434b-8aaf-650b85a25898 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:49.706381 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a972429c-9dc6-434b-8aaf-650b85a25898 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:49.725271 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ebc30540-b078-41d3-836c-d81ad5defd15 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:49.728374 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ebc30540-b078-41d3-836c-d81ad5defd15 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:49.746141 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ebc30540-b078-41d3-836c-d81ad5defd15 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:49.750809 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ebc30540-b078-41d3-836c-d81ad5defd15 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:49.757163 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ebc30540-b078-41d3-836c-d81ad5defd15 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:49.759551 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ebc30540-b078-41d3-836c-d81ad5defd15 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:50.180632 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ebc30540-b078-41d3-836c-d81ad5defd15 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:50.190831 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-a972429c-9dc6-434b-8aaf-650b85a25898 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:50.191767 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ebc30540-b078-41d3-836c-d81ad5defd15 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1314 microversion: 2.1 time: 0.473282 Jun 25 16:06:50.201325 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 40/83] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:49 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1314 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:50.207700 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-55ef7267-00d2-4990-8125-e720145d3d43 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:50.208497 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-55ef7267-00d2-4990-8125-e720145d3d43 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:50.213867 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-a972429c-9dc6-434b-8aaf-650b85a25898 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1321 microversion: 2.1 time: 0.512779 Jun 25 16:06:50.214525 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 44/84] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:49 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1321 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:50.215769 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-55ef7267-00d2-4990-8125-e720145d3d43 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:50.216351 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-55ef7267-00d2-4990-8125-e720145d3d43 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:50.217357 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-55ef7267-00d2-4990-8125-e720145d3d43 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:50.217920 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-55ef7267-00d2-4990-8125-e720145d3d43 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:50.371664 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-55ef7267-00d2-4990-8125-e720145d3d43 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:50.379428 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-55ef7267-00d2-4990-8125-e720145d3d43 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1367 microversion: 2.1 time: 0.177009 Jun 25 16:06:50.380174 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 41/85] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:50 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:51.208346 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-2a964679-8615-4679-9dda-c8f7f245ac5d tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:51.209001 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-2a964679-8615-4679-9dda-c8f7f245ac5d tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:51.215719 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2a964679-8615-4679-9dda-c8f7f245ac5d tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:51.216201 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2a964679-8615-4679-9dda-c8f7f245ac5d tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:51.217008 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2a964679-8615-4679-9dda-c8f7f245ac5d tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:51.217440 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2a964679-8615-4679-9dda-c8f7f245ac5d tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:51.236010 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-966aed41-e7fe-4974-80a0-49ac31fa1b85 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:51.236742 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-966aed41-e7fe-4974-80a0-49ac31fa1b85 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:51.245294 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-966aed41-e7fe-4974-80a0-49ac31fa1b85 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:51.245950 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-966aed41-e7fe-4974-80a0-49ac31fa1b85 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:51.247334 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-966aed41-e7fe-4974-80a0-49ac31fa1b85 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:51.247777 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-966aed41-e7fe-4974-80a0-49ac31fa1b85 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:51.401553 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-2a964679-8615-4679-9dda-c8f7f245ac5d tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:51.410944 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-2a964679-8615-4679-9dda-c8f7f245ac5d tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1314 microversion: 2.1 time: 0.206638 Jun 25 16:06:51.411755 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 45/86] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:51 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:51.420669 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-ef80fa07-12b0-4f4f-ad11-c734fdc080f6 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:51.421394 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-ef80fa07-12b0-4f4f-ad11-c734fdc080f6 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:51.423816 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-966aed41-e7fe-4974-80a0-49ac31fa1b85 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:51.427698 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ef80fa07-12b0-4f4f-ad11-c734fdc080f6 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:51.428235 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ef80fa07-12b0-4f4f-ad11-c734fdc080f6 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:51.429137 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ef80fa07-12b0-4f4f-ad11-c734fdc080f6 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:51.429890 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ef80fa07-12b0-4f4f-ad11-c734fdc080f6 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:51.433100 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-966aed41-e7fe-4974-80a0-49ac31fa1b85 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1321 microversion: 2.1 time: 0.202363 Jun 25 16:06:51.440935 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 42/87] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:51 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:51.570434 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-ef80fa07-12b0-4f4f-ad11-c734fdc080f6 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:51.577924 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-ef80fa07-12b0-4f4f-ad11-c734fdc080f6 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1367 microversion: 2.1 time: 0.164985 Jun 25 16:06:51.578490 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 46/88] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:51 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:52.434292 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-20351c6c-753c-489a-81d0-352e9feedf36 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:52.435391 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-20351c6c-753c-489a-81d0-352e9feedf36 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:52.445475 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-20351c6c-753c-489a-81d0-352e9feedf36 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:52.445910 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-20351c6c-753c-489a-81d0-352e9feedf36 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:52.446876 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-20351c6c-753c-489a-81d0-352e9feedf36 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:52.447316 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-20351c6c-753c-489a-81d0-352e9feedf36 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:52.451219 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-2bdb1624-3e5a-41e9-9e24-c06aa5668d2b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:52.451873 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-2bdb1624-3e5a-41e9-9e24-c06aa5668d2b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:52.458149 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2bdb1624-3e5a-41e9-9e24-c06aa5668d2b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:52.458608 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2bdb1624-3e5a-41e9-9e24-c06aa5668d2b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:52.459361 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2bdb1624-3e5a-41e9-9e24-c06aa5668d2b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:52.459781 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2bdb1624-3e5a-41e9-9e24-c06aa5668d2b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:52.655151 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-20351c6c-753c-489a-81d0-352e9feedf36 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:52.657807 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-2bdb1624-3e5a-41e9-9e24-c06aa5668d2b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:52.665613 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-20351c6c-753c-489a-81d0-352e9feedf36 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1314 microversion: 2.1 time: 0.239868 Jun 25 16:06:52.666152 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 43/89] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:52 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:52.668275 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-2bdb1624-3e5a-41e9-9e24-c06aa5668d2b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1321 microversion: 2.1 time: 0.221043 Jun 25 16:06:52.669333 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 47/90] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:52 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:52.683868 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-24c3474b-f89f-432a-970d-66ab98931363 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:52.684660 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-24c3474b-f89f-432a-970d-66ab98931363 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:52.691235 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-24c3474b-f89f-432a-970d-66ab98931363 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:52.691916 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-24c3474b-f89f-432a-970d-66ab98931363 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:52.692708 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-24c3474b-f89f-432a-970d-66ab98931363 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:52.693151 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-24c3474b-f89f-432a-970d-66ab98931363 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:52.712515 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=100 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:06:52.851295 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-24c3474b-f89f-432a-970d-66ab98931363 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:52.860705 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-24c3474b-f89f-432a-970d-66ab98931363 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1367 microversion: 2.1 time: 0.188945 Jun 25 16:06:52.861258 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 44/91] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:52 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:53.686265 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b778e65b-2ff1-4fb2-95d7-06570dc67b1b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:53.686980 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b778e65b-2ff1-4fb2-95d7-06570dc67b1b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:53.693395 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b778e65b-2ff1-4fb2-95d7-06570dc67b1b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:53.693864 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b778e65b-2ff1-4fb2-95d7-06570dc67b1b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:53.694729 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b778e65b-2ff1-4fb2-95d7-06570dc67b1b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:53.695273 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b778e65b-2ff1-4fb2-95d7-06570dc67b1b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:53.700454 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-04bf99be-4a89-4e98-ba3e-71c6dc2cc41e tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:53.700454 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-04bf99be-4a89-4e98-ba3e-71c6dc2cc41e tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:53.707707 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-04bf99be-4a89-4e98-ba3e-71c6dc2cc41e tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:53.708152 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-04bf99be-4a89-4e98-ba3e-71c6dc2cc41e tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:53.708942 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-04bf99be-4a89-4e98-ba3e-71c6dc2cc41e tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:53.709603 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-04bf99be-4a89-4e98-ba3e-71c6dc2cc41e tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:53.911890 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b778e65b-2ff1-4fb2-95d7-06570dc67b1b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:53.914293 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-04bf99be-4a89-4e98-ba3e-71c6dc2cc41e tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:53.919827 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b778e65b-2ff1-4fb2-95d7-06570dc67b1b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1321 microversion: 2.1 time: 0.237890 Jun 25 16:06:53.920397 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 45/92] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:53 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:06:53.922063 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-04bf99be-4a89-4e98-ba3e-71c6dc2cc41e tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1314 microversion: 2.1 time: 0.241511 Jun 25 16:06:53.922722 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 48/93] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:53 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:53.925179 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b4898833-e90b-442c-b044-9674bd0dffdb tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:53.925766 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b4898833-e90b-442c-b044-9674bd0dffdb tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:53.931980 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b4898833-e90b-442c-b044-9674bd0dffdb tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:53.932439 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b4898833-e90b-442c-b044-9674bd0dffdb tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:53.933316 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b4898833-e90b-442c-b044-9674bd0dffdb tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:53.933745 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b4898833-e90b-442c-b044-9674bd0dffdb tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:54.068773 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b4898833-e90b-442c-b044-9674bd0dffdb tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:54.077270 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b4898833-e90b-442c-b044-9674bd0dffdb tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1367 microversion: 2.1 time: 0.155371 Jun 25 16:06:54.077861 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 46/94] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:53 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:54.941957 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-33d3e690-d623-4f6c-be63-468431384904 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:54.942570 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-33d3e690-d623-4f6c-be63-468431384904 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:54.950833 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-33d3e690-d623-4f6c-be63-468431384904 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:54.951308 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-33d3e690-d623-4f6c-be63-468431384904 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:54.952274 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-33d3e690-d623-4f6c-be63-468431384904 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:54.952859 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-33d3e690-d623-4f6c-be63-468431384904 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:55.044638 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-7fc2cca1-5edc-4c35-89f6-b82d43e22427 req-24d684b4-3c8e-448e-80db-8171d4adb4f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7feaccc2-e2e8-4644-87a9-4b88cd8767d5", "name": "network-vif-plugged", "status": "completed", "tag": "dda3a175-359c-4380-a748-ac6e5ec45c69"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:06:55.071364 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-7fc2cca1-5edc-4c35-89f6-b82d43e22427 req-24d684b4-3c8e-448e-80db-8171d4adb4f9 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:55.072120 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-7fc2cca1-5edc-4c35-89f6-b82d43e22427 req-24d684b4-3c8e-448e-80db-8171d4adb4f9 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:55.086465 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-7fc2cca1-5edc-4c35-89f6-b82d43e22427 req-24d684b4-3c8e-448e-80db-8171d4adb4f9 service nova] Creating event network-vif-plugged:dda3a175-359c-4380-a748-ac6e5ec45c69 for instance 7feaccc2-e2e8-4644-87a9-4b88cd8767d5 on hv-cinder-84762 Jun 25 16:06:55.094830 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-7fc2cca1-5edc-4c35-89f6-b82d43e22427 req-24d684b4-3c8e-448e-80db-8171d4adb4f9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.219933 Jun 25 16:06:55.097057 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 49/95] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:06:55.104067 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-74755a90-5fbe-443f-bdcf-f86818fa5ada tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:55.104807 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-74755a90-5fbe-443f-bdcf-f86818fa5ada tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:55.113228 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-74755a90-5fbe-443f-bdcf-f86818fa5ada tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:55.113571 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-74755a90-5fbe-443f-bdcf-f86818fa5ada tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:55.114354 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-74755a90-5fbe-443f-bdcf-f86818fa5ada tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:55.114937 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-74755a90-5fbe-443f-bdcf-f86818fa5ada tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:55.233377 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-33d3e690-d623-4f6c-be63-468431384904 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:55.245828 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-33d3e690-d623-4f6c-be63-468431384904 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1321 microversion: 2.1 time: 0.309829 Jun 25 16:06:55.257539 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 47/96] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:54 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1321 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:06:55.267530 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-514e49ad-e8c8-4e5a-a32f-a6e70212d5bf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:55.269907 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-514e49ad-e8c8-4e5a-a32f-a6e70212d5bf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:55.277348 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-514e49ad-e8c8-4e5a-a32f-a6e70212d5bf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:55.278151 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-514e49ad-e8c8-4e5a-a32f-a6e70212d5bf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:55.279016 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-514e49ad-e8c8-4e5a-a32f-a6e70212d5bf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:55.279543 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-514e49ad-e8c8-4e5a-a32f-a6e70212d5bf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:55.374703 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-74755a90-5fbe-443f-bdcf-f86818fa5ada tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:55.384834 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-74755a90-5fbe-443f-bdcf-f86818fa5ada tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1314 microversion: 2.1 time: 0.285159 Jun 25 16:06:55.386101 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 50/97] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:55 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:55.497401 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-514e49ad-e8c8-4e5a-a32f-a6e70212d5bf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:55.506050 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-514e49ad-e8c8-4e5a-a32f-a6e70212d5bf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1367 microversion: 2.1 time: 0.247303 Jun 25 16:06:55.517177 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 48/98] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:55 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1367 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:56.264528 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-038cf98e-b548-4c88-a72a-4454107f6356 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:56.265724 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-038cf98e-b548-4c88-a72a-4454107f6356 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:56.272988 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-038cf98e-b548-4c88-a72a-4454107f6356 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:56.273587 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-038cf98e-b548-4c88-a72a-4454107f6356 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:56.274399 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-038cf98e-b548-4c88-a72a-4454107f6356 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:56.274812 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-038cf98e-b548-4c88-a72a-4454107f6356 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:56.404636 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8ee7c4cb-5b25-438a-9bbd-a07af5c20426 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:56.405247 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8ee7c4cb-5b25-438a-9bbd-a07af5c20426 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:56.412236 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8ee7c4cb-5b25-438a-9bbd-a07af5c20426 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:56.413421 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8ee7c4cb-5b25-438a-9bbd-a07af5c20426 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:56.414571 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8ee7c4cb-5b25-438a-9bbd-a07af5c20426 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:56.415285 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8ee7c4cb-5b25-438a-9bbd-a07af5c20426 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:56.508857 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-038cf98e-b548-4c88-a72a-4454107f6356 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:56.518285 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-038cf98e-b548-4c88-a72a-4454107f6356 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1321 microversion: 2.1 time: 0.257882 Jun 25 16:06:56.519117 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 51/99] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:56 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:56.534539 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-91926ba7-5695-4d68-87d3-951d7d73b67a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:56.535150 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-91926ba7-5695-4d68-87d3-951d7d73b67a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:56.542254 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-91926ba7-5695-4d68-87d3-951d7d73b67a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:56.542987 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-91926ba7-5695-4d68-87d3-951d7d73b67a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:56.543756 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-91926ba7-5695-4d68-87d3-951d7d73b67a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:56.544221 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-91926ba7-5695-4d68-87d3-951d7d73b67a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:56.579193 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=100 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:06:56.672566 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8ee7c4cb-5b25-438a-9bbd-a07af5c20426 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:56.681546 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8ee7c4cb-5b25-438a-9bbd-a07af5c20426 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1314 microversion: 2.1 time: 0.281527 Jun 25 16:06:56.682343 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 49/100] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:56 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:06:56.727182 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-91926ba7-5695-4d68-87d3-951d7d73b67a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:56.734609 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-91926ba7-5695-4d68-87d3-951d7d73b67a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1367 microversion: 2.1 time: 0.204674 Jun 25 16:06:56.735351 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 52/101] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:56 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:57.162721 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-e3592d19-380c-41f8-a6cc-51ec7d81c140 req-bacd25e0-2811-4d5c-9f0e-a6c3d5473cdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01f7cc79-f68f-4fe1-b31e-1cb4f0fea810", "name": "network-vif-plugged", "status": "completed", "tag": "da56dc06-e8a5-4eac-a9b3-a873439d682c"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:06:57.174933 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e3592d19-380c-41f8-a6cc-51ec7d81c140 req-bacd25e0-2811-4d5c-9f0e-a6c3d5473cdd service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:57.175381 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e3592d19-380c-41f8-a6cc-51ec7d81c140 req-bacd25e0-2811-4d5c-9f0e-a6c3d5473cdd service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:57.199788 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-e3592d19-380c-41f8-a6cc-51ec7d81c140 req-bacd25e0-2811-4d5c-9f0e-a6c3d5473cdd service nova] Creating event network-vif-plugged:da56dc06-e8a5-4eac-a9b3-a873439d682c for instance 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 on hv-cinder-84762 Jun 25 16:06:57.200199 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e3592d19-380c-41f8-a6cc-51ec7d81c140 req-bacd25e0-2811-4d5c-9f0e-a6c3d5473cdd service nova] Acquired lock "compute-rpcapi-router" {{(pid=117793) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 25 16:06:57.201317 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f622d0c6-d887-4132-bb8a-eb6dc25185c7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:57.201961 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f622d0c6-d887-4132-bb8a-eb6dc25185c7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:57.202779 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f622d0c6-d887-4132-bb8a-eb6dc25185c7 None None] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:57.203175 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f622d0c6-d887-4132-bb8a-eb6dc25185c7 None None] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:57.212686 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.compute.rpcapi [None req-f622d0c6-d887-4132-bb8a-eb6dc25185c7 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 25 16:06:57.213792 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f622d0c6-d887-4132-bb8a-eb6dc25185c7 None None] Releasing lock "compute-rpcapi-router" {{(pid=117793) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 25 16:06:57.229678 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f622d0c6-d887-4132-bb8a-eb6dc25185c7 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070888 Jun 25 16:06:57.230727 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 50/102] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:06:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:06:57.542116 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-e54c55f9-a209-480d-b076-241c4abe8a3c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:57.543657 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-e54c55f9-a209-480d-b076-241c4abe8a3c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:57.575414 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e54c55f9-a209-480d-b076-241c4abe8a3c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:57.575944 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e54c55f9-a209-480d-b076-241c4abe8a3c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:57.577557 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e54c55f9-a209-480d-b076-241c4abe8a3c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:57.577994 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e54c55f9-a209-480d-b076-241c4abe8a3c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:57.699682 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4efda066-afaa-48dd-b6f8-70e793e5dcbb tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:57.700384 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4efda066-afaa-48dd-b6f8-70e793e5dcbb tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:57.711286 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4efda066-afaa-48dd-b6f8-70e793e5dcbb tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:57.711471 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4efda066-afaa-48dd-b6f8-70e793e5dcbb tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:57.718647 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4efda066-afaa-48dd-b6f8-70e793e5dcbb tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:57.719373 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4efda066-afaa-48dd-b6f8-70e793e5dcbb tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:57.824487 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-e54c55f9-a209-480d-b076-241c4abe8a3c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:57.832062 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-e54c55f9-a209-480d-b076-241c4abe8a3c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1321 microversion: 2.1 time: 0.295435 Jun 25 16:06:57.833051 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 53/103] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:57 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1321 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:57.837609 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-03a0bbbe-b990-403c-a61f-c3cbc1b9dbf4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:57.838215 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-03a0bbbe-b990-403c-a61f-c3cbc1b9dbf4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:57.847815 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-03a0bbbe-b990-403c-a61f-c3cbc1b9dbf4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:57.847815 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-03a0bbbe-b990-403c-a61f-c3cbc1b9dbf4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:57.847815 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-03a0bbbe-b990-403c-a61f-c3cbc1b9dbf4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:57.847815 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-03a0bbbe-b990-403c-a61f-c3cbc1b9dbf4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:57.897159 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4efda066-afaa-48dd-b6f8-70e793e5dcbb tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:57.904737 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4efda066-afaa-48dd-b6f8-70e793e5dcbb tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1314 microversion: 2.1 time: 0.209250 Jun 25 16:06:57.905480 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 51/104] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:57 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:06:57.998319 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-03a0bbbe-b990-403c-a61f-c3cbc1b9dbf4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:58.006230 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-03a0bbbe-b990-403c-a61f-c3cbc1b9dbf4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1367 microversion: 2.1 time: 0.172187 Jun 25 16:06:58.008820 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 54/105] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:57 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:58.848493 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7272ff5a-255e-4e5c-8462-7095b8157d20 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:58.850055 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7272ff5a-255e-4e5c-8462-7095b8157d20 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:58.858380 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7272ff5a-255e-4e5c-8462-7095b8157d20 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:58.858839 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7272ff5a-255e-4e5c-8462-7095b8157d20 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:58.860489 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7272ff5a-255e-4e5c-8462-7095b8157d20 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:58.861153 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7272ff5a-255e-4e5c-8462-7095b8157d20 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:58.922589 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-44d2e726-3e61-4bbe-8a28-20b6ab5127ab tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:58.923451 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-44d2e726-3e61-4bbe-8a28-20b6ab5127ab tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:58.930232 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-44d2e726-3e61-4bbe-8a28-20b6ab5127ab tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:58.930820 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-44d2e726-3e61-4bbe-8a28-20b6ab5127ab tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:58.931692 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-44d2e726-3e61-4bbe-8a28-20b6ab5127ab tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:58.932309 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-44d2e726-3e61-4bbe-8a28-20b6ab5127ab tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:59.144497 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7272ff5a-255e-4e5c-8462-7095b8157d20 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:59.171751 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7272ff5a-255e-4e5c-8462-7095b8157d20 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1321 microversion: 2.1 time: 0.326910 Jun 25 16:06:59.172669 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 52/106] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:58 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1321 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:06:59.185043 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-90ea986d-5bea-4bb9-98e6-f082ea6df801 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:06:59.185734 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-90ea986d-5bea-4bb9-98e6-f082ea6df801 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:06:59.192129 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-90ea986d-5bea-4bb9-98e6-f082ea6df801 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:59.196451 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-90ea986d-5bea-4bb9-98e6-f082ea6df801 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:59.198881 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-90ea986d-5bea-4bb9-98e6-f082ea6df801 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:06:59.200964 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-90ea986d-5bea-4bb9-98e6-f082ea6df801 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:06:59.232004 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-44d2e726-3e61-4bbe-8a28-20b6ab5127ab tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:59.239909 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-44d2e726-3e61-4bbe-8a28-20b6ab5127ab tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1314 microversion: 2.1 time: 0.321665 Jun 25 16:06:59.240506 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 55/107] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:58 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:06:59.420648 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-90ea986d-5bea-4bb9-98e6-f082ea6df801 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:06:59.429890 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-90ea986d-5bea-4bb9-98e6-f082ea6df801 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1367 microversion: 2.1 time: 0.256140 Jun 25 16:06:59.441127 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 53/108] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:06:59 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1367 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:00.188617 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-bf87c860-a2a0-4330-a5b3-0245d977ab81 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:00.189220 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-bf87c860-a2a0-4330-a5b3-0245d977ab81 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:00.197278 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-bf87c860-a2a0-4330-a5b3-0245d977ab81 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:00.197698 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-bf87c860-a2a0-4330-a5b3-0245d977ab81 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:00.198639 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-bf87c860-a2a0-4330-a5b3-0245d977ab81 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:00.199134 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-bf87c860-a2a0-4330-a5b3-0245d977ab81 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:00.266430 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-11a259e4-9754-4e0c-a463-9da87b017e43 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:00.267050 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-11a259e4-9754-4e0c-a463-9da87b017e43 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:00.290732 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-11a259e4-9754-4e0c-a463-9da87b017e43 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:00.291608 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-11a259e4-9754-4e0c-a463-9da87b017e43 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:00.292598 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-11a259e4-9754-4e0c-a463-9da87b017e43 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:00.293182 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-11a259e4-9754-4e0c-a463-9da87b017e43 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:00.462743 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-bf87c860-a2a0-4330-a5b3-0245d977ab81 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:00.488203 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-bf87c860-a2a0-4330-a5b3-0245d977ab81 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1321 microversion: 2.1 time: 0.292015 Jun 25 16:07:00.489497 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 56/109] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:00 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:00.515897 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-11a259e4-9754-4e0c-a463-9da87b017e43 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:00.522817 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-20503371-d129-4d56-83f5-1cd496966435 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:00.523808 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-20503371-d129-4d56-83f5-1cd496966435 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:00.539607 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-11a259e4-9754-4e0c-a463-9da87b017e43 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1314 microversion: 2.1 time: 0.278933 Jun 25 16:07:00.540120 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-20503371-d129-4d56-83f5-1cd496966435 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:00.541310 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-20503371-d129-4d56-83f5-1cd496966435 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:00.543050 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 54/110] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:00 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1314 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:07:00.543367 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-20503371-d129-4d56-83f5-1cd496966435 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:00.543961 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-20503371-d129-4d56-83f5-1cd496966435 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:00.835692 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-7e9b4f49-c43c-443e-8a91-05b4dbc6008f req-3b013f57-648f-47a6-9b80-fc5c90d8a468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc4f0bb-0b30-429c-af92-a30f31e4b60f", "name": "network-vif-plugged", "status": "completed", "tag": "da8ae9de-1432-4b4c-9379-90aae9bf04a3"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:07:00.873405 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-20503371-d129-4d56-83f5-1cd496966435 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:00.881308 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-20503371-d129-4d56-83f5-1cd496966435 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1367 microversion: 2.1 time: 0.378579 Jun 25 16:07:00.881882 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 57/111] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:00 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1367 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:00.886739 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-7e9b4f49-c43c-443e-8a91-05b4dbc6008f req-3b013f57-648f-47a6-9b80-fc5c90d8a468 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:00.887595 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-7e9b4f49-c43c-443e-8a91-05b4dbc6008f req-3b013f57-648f-47a6-9b80-fc5c90d8a468 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:00.904674 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-7e9b4f49-c43c-443e-8a91-05b4dbc6008f req-3b013f57-648f-47a6-9b80-fc5c90d8a468 service nova] Creating event network-vif-plugged:da8ae9de-1432-4b4c-9379-90aae9bf04a3 for instance 9dc4f0bb-0b30-429c-af92-a30f31e4b60f on hv-cinder-84762 Jun 25 16:07:00.929255 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-7e9b4f49-c43c-443e-8a91-05b4dbc6008f req-3b013f57-648f-47a6-9b80-fc5c90d8a468 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095602 Jun 25 16:07:00.932325 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 55/112] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 16:07:01.505493 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-d7bb4c19-8fbc-47de-ad2e-ada3e606ec7c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:01.506144 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-d7bb4c19-8fbc-47de-ad2e-ada3e606ec7c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:01.512299 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d7bb4c19-8fbc-47de-ad2e-ada3e606ec7c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:01.512766 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d7bb4c19-8fbc-47de-ad2e-ada3e606ec7c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:01.513540 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d7bb4c19-8fbc-47de-ad2e-ada3e606ec7c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:01.513979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d7bb4c19-8fbc-47de-ad2e-ada3e606ec7c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:01.559944 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2a5daacc-578c-44ed-8f47-9f1d8d542c7f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:01.564576 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2a5daacc-578c-44ed-8f47-9f1d8d542c7f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:01.577769 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2a5daacc-578c-44ed-8f47-9f1d8d542c7f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:01.578236 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2a5daacc-578c-44ed-8f47-9f1d8d542c7f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:01.579029 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2a5daacc-578c-44ed-8f47-9f1d8d542c7f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:01.579473 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2a5daacc-578c-44ed-8f47-9f1d8d542c7f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:01.678877 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d7bb4c19-8fbc-47de-ad2e-ada3e606ec7c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:01.687013 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-d7bb4c19-8fbc-47de-ad2e-ada3e606ec7c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1321 microversion: 2.1 time: 0.185451 Jun 25 16:07:01.696903 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 58/113] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:01 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:01.779540 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2a5daacc-578c-44ed-8f47-9f1d8d542c7f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:01.787037 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2a5daacc-578c-44ed-8f47-9f1d8d542c7f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1502 microversion: 2.1 time: 0.231301 Jun 25 16:07:01.787598 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 56/114] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:01 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1502 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:07:01.898811 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-91617232-23c4-4506-9083-3b810ed12547 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:01.899421 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-91617232-23c4-4506-9083-3b810ed12547 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:01.905391 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-91617232-23c4-4506-9083-3b810ed12547 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:01.905842 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-91617232-23c4-4506-9083-3b810ed12547 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:01.906578 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-91617232-23c4-4506-9083-3b810ed12547 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:01.907049 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-91617232-23c4-4506-9083-3b810ed12547 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:02.047400 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-91617232-23c4-4506-9083-3b810ed12547 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:02.060348 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-91617232-23c4-4506-9083-3b810ed12547 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1367 microversion: 2.1 time: 0.160654 Jun 25 16:07:02.060348 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 59/115] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:01 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:02.705441 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ced7ab6a-342b-41f0-a9c8-3b39ce8f0c08 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:02.706039 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ced7ab6a-342b-41f0-a9c8-3b39ce8f0c08 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:02.712432 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ced7ab6a-342b-41f0-a9c8-3b39ce8f0c08 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:02.712896 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ced7ab6a-342b-41f0-a9c8-3b39ce8f0c08 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:02.713662 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ced7ab6a-342b-41f0-a9c8-3b39ce8f0c08 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:02.714100 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ced7ab6a-342b-41f0-a9c8-3b39ce8f0c08 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:02.847386 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ced7ab6a-342b-41f0-a9c8-3b39ce8f0c08 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:02.855161 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ced7ab6a-342b-41f0-a9c8-3b39ce8f0c08 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1321 microversion: 2.1 time: 0.153615 Jun 25 16:07:02.855731 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 57/116] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:02 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:02.967415 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-ae6952d8-e3c4-4605-9992-b4fa8bc75fdc req-bbc9d1e7-2f26-4d75-879c-b2c00dac26b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5f6023f-52bc-4a18-af15-b1c7f2896f75", "name": "network-vif-plugged", "status": "completed", "tag": "e355ac8e-fb57-4cd6-9b51-2346658384b8"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:07:02.975804 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-ae6952d8-e3c4-4605-9992-b4fa8bc75fdc req-bbc9d1e7-2f26-4d75-879c-b2c00dac26b9 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:02.976224 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-ae6952d8-e3c4-4605-9992-b4fa8bc75fdc req-bbc9d1e7-2f26-4d75-879c-b2c00dac26b9 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:02.987369 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-ae6952d8-e3c4-4605-9992-b4fa8bc75fdc req-bbc9d1e7-2f26-4d75-879c-b2c00dac26b9 service nova] Creating event network-vif-plugged:e355ac8e-fb57-4cd6-9b51-2346658384b8 for instance f5f6023f-52bc-4a18-af15-b1c7f2896f75 on hv-cinder-84762 Jun 25 16:07:02.992605 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-ae6952d8-e3c4-4605-9992-b4fa8bc75fdc req-bbc9d1e7-2f26-4d75-879c-b2c00dac26b9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028883 Jun 25 16:07:02.993180 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 60/117] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:07:03.076934 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-91f3937a-6b69-4c0f-8140-fadb680dadb1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:03.078045 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-91f3937a-6b69-4c0f-8140-fadb680dadb1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:03.087298 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91f3937a-6b69-4c0f-8140-fadb680dadb1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:03.087728 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91f3937a-6b69-4c0f-8140-fadb680dadb1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:03.088516 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91f3937a-6b69-4c0f-8140-fadb680dadb1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:03.088941 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91f3937a-6b69-4c0f-8140-fadb680dadb1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:03.217498 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-91f3937a-6b69-4c0f-8140-fadb680dadb1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:03.228895 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-91f3937a-6b69-4c0f-8140-fadb680dadb1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1367 microversion: 2.1 time: 0.158324 Jun 25 16:07:03.229687 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 58/118] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:03 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:03.873405 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-aa92fe65-3163-43e7-ac63-6295bddaf7fa tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:03.874103 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-aa92fe65-3163-43e7-ac63-6295bddaf7fa tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:03.880612 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-aa92fe65-3163-43e7-ac63-6295bddaf7fa tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:03.881063 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-aa92fe65-3163-43e7-ac63-6295bddaf7fa tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:03.881827 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-aa92fe65-3163-43e7-ac63-6295bddaf7fa tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:03.882258 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-aa92fe65-3163-43e7-ac63-6295bddaf7fa tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:04.018319 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-aa92fe65-3163-43e7-ac63-6295bddaf7fa tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:04.028641 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-aa92fe65-3163-43e7-ac63-6295bddaf7fa tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1321 microversion: 2.1 time: 0.159159 Jun 25 16:07:04.029412 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 61/119] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:03 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:04.252733 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f25eeac5-dd80-4b1e-b9bc-0a072b9de4c1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:04.253272 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f25eeac5-dd80-4b1e-b9bc-0a072b9de4c1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:04.261020 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f25eeac5-dd80-4b1e-b9bc-0a072b9de4c1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:04.261447 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f25eeac5-dd80-4b1e-b9bc-0a072b9de4c1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:04.262215 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f25eeac5-dd80-4b1e-b9bc-0a072b9de4c1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:04.262647 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f25eeac5-dd80-4b1e-b9bc-0a072b9de4c1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:04.394987 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f25eeac5-dd80-4b1e-b9bc-0a072b9de4c1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:04.406809 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f25eeac5-dd80-4b1e-b9bc-0a072b9de4c1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1367 microversion: 2.1 time: 0.160124 Jun 25 16:07:04.407389 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 59/120] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:04 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:05.045964 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-7649a01f-30a1-409b-946c-a9fccc038fa6 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:05.046505 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-7649a01f-30a1-409b-946c-a9fccc038fa6 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:05.052796 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7649a01f-30a1-409b-946c-a9fccc038fa6 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:05.053314 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7649a01f-30a1-409b-946c-a9fccc038fa6 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:05.054164 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7649a01f-30a1-409b-946c-a9fccc038fa6 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:05.054606 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7649a01f-30a1-409b-946c-a9fccc038fa6 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:05.188344 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-7649a01f-30a1-409b-946c-a9fccc038fa6 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:05.196949 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-7649a01f-30a1-409b-946c-a9fccc038fa6 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1321 microversion: 2.1 time: 0.154794 Jun 25 16:07:05.197574 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 62/121] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:05 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:05.298657 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4be24f2e-45cf-4ba9-9c65-aec07fa747f4 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f89f5ba-a339-4deb-9091-afcaa53231a1"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:07:05.299794 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4be24f2e-45cf-4ba9-9c65-aec07fa747f4 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:05.306062 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4be24f2e-45cf-4ba9-9c65-aec07fa747f4 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:05.306505 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4be24f2e-45cf-4ba9-9c65-aec07fa747f4 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:05.307556 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4be24f2e-45cf-4ba9-9c65-aec07fa747f4 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:05.307984 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4be24f2e-45cf-4ba9-9c65-aec07fa747f4 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:05.423382 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-1c5339b0-d984-434e-ba51-638ba09ca5cf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:05.423984 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-1c5339b0-d984-434e-ba51-638ba09ca5cf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:05.430705 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1c5339b0-d984-434e-ba51-638ba09ca5cf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:05.431152 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1c5339b0-d984-434e-ba51-638ba09ca5cf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:05.431933 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1c5339b0-d984-434e-ba51-638ba09ca5cf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:05.432430 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1c5339b0-d984-434e-ba51-638ba09ca5cf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:05.571790 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-1c5339b0-d984-434e-ba51-638ba09ca5cf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:05.579433 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-1c5339b0-d984-434e-ba51-638ba09ca5cf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1557 microversion: 2.1 time: 0.160140 Jun 25 16:07:05.580018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 63/122] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:05 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1557 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:07:05.597225 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-2f48d3bf-80c8-47ab-badd-7e2ac9069e09 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:05.597721 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-2f48d3bf-80c8-47ab-badd-7e2ac9069e09 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:05.603946 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2f48d3bf-80c8-47ab-badd-7e2ac9069e09 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:05.604430 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2f48d3bf-80c8-47ab-badd-7e2ac9069e09 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:05.605223 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2f48d3bf-80c8-47ab-badd-7e2ac9069e09 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:05.605659 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2f48d3bf-80c8-47ab-badd-7e2ac9069e09 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:05.923779 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-2f48d3bf-80c8-47ab-badd-7e2ac9069e09 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.330376 Jun 25 16:07:05.924363 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 64/123] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Jun 25 16:07:05 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f/os-interface => generated 284 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 16:07:06.218258 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-92e93512-7d58-4556-8484-d11aed6f16bf tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:06.220614 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-92e93512-7d58-4556-8484-d11aed6f16bf tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:06.236999 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-92e93512-7d58-4556-8484-d11aed6f16bf tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:06.238374 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-92e93512-7d58-4556-8484-d11aed6f16bf tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:06.240028 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-92e93512-7d58-4556-8484-d11aed6f16bf tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:06.242023 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-92e93512-7d58-4556-8484-d11aed6f16bf tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:06.401969 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:07:06.416428 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4be24f2e-45cf-4ba9-9c65-aec07fa747f4 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "POST /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.124453 Jun 25 16:07:06.422542 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 60/124] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Jun 25 16:07:05 2022] POST /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810/os-volume_attachments => generated 194 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 16:07:06.477201 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-92e93512-7d58-4556-8484-d11aed6f16bf tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:06.487963 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-92e93512-7d58-4556-8484-d11aed6f16bf tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1321 microversion: 2.1 time: 0.277269 Jun 25 16:07:06.489960 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 65/125] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:06 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1321 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:07.504918 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:07:07.510945 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c90b1c0d-fc9b-4a2f-9a00-aaf56c5a50ff tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:07.511883 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c90b1c0d-fc9b-4a2f-9a00-aaf56c5a50ff tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:07.521652 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c90b1c0d-fc9b-4a2f-9a00-aaf56c5a50ff tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:07.523790 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c90b1c0d-fc9b-4a2f-9a00-aaf56c5a50ff tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:07.524993 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c90b1c0d-fc9b-4a2f-9a00-aaf56c5a50ff tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:07.526314 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c90b1c0d-fc9b-4a2f-9a00-aaf56c5a50ff tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:07.623898 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-9a902507-2754-47fe-b0f8-648065054b57 req-354c4934-7bcc-4b05-8543-94e6db67797e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dc4f0bb-0b30-429c-af92-a30f31e4b60f", "tag": "da8ae9de-1432-4b4c-9379-90aae9bf04a3"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:07:07.629435 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_api:SELECT=74 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:07:07.636013 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-9a902507-2754-47fe-b0f8-648065054b57 req-354c4934-7bcc-4b05-8543-94e6db67797e service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:07.636722 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-9a902507-2754-47fe-b0f8-648065054b57 req-354c4934-7bcc-4b05-8543-94e6db67797e service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:07.659617 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-9a902507-2754-47fe-b0f8-648065054b57 req-354c4934-7bcc-4b05-8543-94e6db67797e service nova] Creating event network-changed:da8ae9de-1432-4b4c-9379-90aae9bf04a3 for instance 9dc4f0bb-0b30-429c-af92-a30f31e4b60f on hv-cinder-84762 Jun 25 16:07:07.665288 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-9a902507-2754-47fe-b0f8-648065054b57 req-354c4934-7bcc-4b05-8543-94e6db67797e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045097 Jun 25 16:07:07.666068 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 66/126] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:07:07.791253 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c90b1c0d-fc9b-4a2f-9a00-aaf56c5a50ff tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:07.806389 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c90b1c0d-fc9b-4a2f-9a00-aaf56c5a50ff tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1515 microversion: 2.1 time: 0.302380 Jun 25 16:07:07.808194 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 61/127] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:07 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1515 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:07.831522 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-00d18b31-ee89-4607-b5a6-52487c788389 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:07:07.832710 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-00d18b31-ee89-4607-b5a6-52487c788389 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:07.853426 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-00d18b31-ee89-4607-b5a6-52487c788389 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:07.856303 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-00d18b31-ee89-4607-b5a6-52487c788389 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:07.857692 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-00d18b31-ee89-4607-b5a6-52487c788389 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:07.861017 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-00d18b31-ee89-4607-b5a6-52487c788389 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:07.912110 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.objects.instance [None req-00d18b31-ee89-4607-b5a6-52487c788389 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lazy-loading 'flavor' on Instance uuid f5f6023f-52bc-4a18-af15-b1c7f2896f75 {{(pid=117794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 16:07:08.066955 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-00d18b31-ee89-4607-b5a6-52487c788389 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "POST /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75/action" status: 200 len: 32 microversion: 2.1 time: 0.242846 Jun 25 16:07:08.071970 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 67/128] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Jun 25 16:07:07 2022] POST /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75/action => generated 32 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 16:07:08.078166 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2644cec1-1547-4b5e-8c60-91bcd0a5238e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:08.078778 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2644cec1-1547-4b5e-8c60-91bcd0a5238e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:08.086669 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2644cec1-1547-4b5e-8c60-91bcd0a5238e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:08.087567 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2644cec1-1547-4b5e-8c60-91bcd0a5238e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:08.088691 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2644cec1-1547-4b5e-8c60-91bcd0a5238e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:08.089251 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2644cec1-1547-4b5e-8c60-91bcd0a5238e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:08.236402 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2644cec1-1547-4b5e-8c60-91bcd0a5238e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:08.245313 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2644cec1-1547-4b5e-8c60-91bcd0a5238e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1521 microversion: 2.1 time: 0.171947 Jun 25 16:07:08.245887 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 62/129] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:08 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:09.264301 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-9be7fd9e-d43e-4c1c-968d-54e0b51dfef9 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:09.265312 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-9be7fd9e-d43e-4c1c-968d-54e0b51dfef9 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:09.273198 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9be7fd9e-d43e-4c1c-968d-54e0b51dfef9 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:09.273665 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9be7fd9e-d43e-4c1c-968d-54e0b51dfef9 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:09.274465 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9be7fd9e-d43e-4c1c-968d-54e0b51dfef9 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:09.274916 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9be7fd9e-d43e-4c1c-968d-54e0b51dfef9 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:09.418333 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-9be7fd9e-d43e-4c1c-968d-54e0b51dfef9 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:09.423419 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:07:09.430813 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-9be7fd9e-d43e-4c1c-968d-54e0b51dfef9 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1521 microversion: 2.1 time: 0.170578 Jun 25 16:07:09.431614 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 68/130] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:09 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:10.454646 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a7d58904-56e7-48a7-b1d5-aa75a2157f10 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:10.455433 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a7d58904-56e7-48a7-b1d5-aa75a2157f10 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:10.463710 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a7d58904-56e7-48a7-b1d5-aa75a2157f10 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:10.464162 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a7d58904-56e7-48a7-b1d5-aa75a2157f10 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:10.464960 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a7d58904-56e7-48a7-b1d5-aa75a2157f10 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:10.465422 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a7d58904-56e7-48a7-b1d5-aa75a2157f10 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:10.701240 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a7d58904-56e7-48a7-b1d5-aa75a2157f10 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:10.710497 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a7d58904-56e7-48a7-b1d5-aa75a2157f10 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1521 microversion: 2.1 time: 0.260135 Jun 25 16:07:10.711558 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 63/131] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:10 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:11.730057 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-8ca30552-5049-456a-909d-fc46b6e4eeab tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:11.730638 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-8ca30552-5049-456a-909d-fc46b6e4eeab tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:11.737793 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8ca30552-5049-456a-909d-fc46b6e4eeab tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:11.738342 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8ca30552-5049-456a-909d-fc46b6e4eeab tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:11.739059 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8ca30552-5049-456a-909d-fc46b6e4eeab tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:11.739503 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8ca30552-5049-456a-909d-fc46b6e4eeab tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:11.883289 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-8ca30552-5049-456a-909d-fc46b6e4eeab tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:11.892685 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-8ca30552-5049-456a-909d-fc46b6e4eeab tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1521 microversion: 2.1 time: 0.166672 Jun 25 16:07:11.893298 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 69/132] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:11 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:12.913130 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-060d654c-6dd4-4fc0-92da-81b0ae8df49e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:12.914119 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-060d654c-6dd4-4fc0-92da-81b0ae8df49e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:12.917421 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=68 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:07:12.925214 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-060d654c-6dd4-4fc0-92da-81b0ae8df49e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:12.925873 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-060d654c-6dd4-4fc0-92da-81b0ae8df49e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:12.926965 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-060d654c-6dd4-4fc0-92da-81b0ae8df49e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:12.927601 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-060d654c-6dd4-4fc0-92da-81b0ae8df49e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:13.101757 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-060d654c-6dd4-4fc0-92da-81b0ae8df49e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:13.111894 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-060d654c-6dd4-4fc0-92da-81b0ae8df49e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1521 microversion: 2.1 time: 0.204361 Jun 25 16:07:13.121952 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 64/133] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:12 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:14.129562 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-8cfd0ac3-2d6e-4ec8-b989-bd6c651788e2 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:14.130168 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-8cfd0ac3-2d6e-4ec8-b989-bd6c651788e2 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:14.136763 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8cfd0ac3-2d6e-4ec8-b989-bd6c651788e2 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:14.137204 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8cfd0ac3-2d6e-4ec8-b989-bd6c651788e2 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:14.137971 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8cfd0ac3-2d6e-4ec8-b989-bd6c651788e2 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:14.138384 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8cfd0ac3-2d6e-4ec8-b989-bd6c651788e2 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:14.267785 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-8cfd0ac3-2d6e-4ec8-b989-bd6c651788e2 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:14.276705 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-8cfd0ac3-2d6e-4ec8-b989-bd6c651788e2 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1521 microversion: 2.1 time: 0.150913 Jun 25 16:07:14.277312 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 70/134] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:14 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:15.293883 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c52f533a-e466-4f6d-8d35-82673caf235c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:15.294571 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c52f533a-e466-4f6d-8d35-82673caf235c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:15.301478 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c52f533a-e466-4f6d-8d35-82673caf235c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:15.301932 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c52f533a-e466-4f6d-8d35-82673caf235c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:15.302720 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c52f533a-e466-4f6d-8d35-82673caf235c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:15.303333 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c52f533a-e466-4f6d-8d35-82673caf235c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:15.443063 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c52f533a-e466-4f6d-8d35-82673caf235c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:15.451352 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c52f533a-e466-4f6d-8d35-82673caf235c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1521 microversion: 2.1 time: 0.161214 Jun 25 16:07:15.451980 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 65/135] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:15 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:16.468620 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-1774ff8c-eb71-4828-849d-13917ec5efff tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:16.469200 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-1774ff8c-eb71-4828-849d-13917ec5efff tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:16.475973 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1774ff8c-eb71-4828-849d-13917ec5efff tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:16.476746 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1774ff8c-eb71-4828-849d-13917ec5efff tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:16.477638 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1774ff8c-eb71-4828-849d-13917ec5efff tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:16.478151 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1774ff8c-eb71-4828-849d-13917ec5efff tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:16.640459 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-1774ff8c-eb71-4828-849d-13917ec5efff tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:16.648751 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-1774ff8c-eb71-4828-849d-13917ec5efff tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1521 microversion: 2.1 time: 0.184113 Jun 25 16:07:16.649366 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 71/136] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:16 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:17.666207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f96b91f3-9e17-446a-90e9-cdd5348b3ded tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:17.666948 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f96b91f3-9e17-446a-90e9-cdd5348b3ded tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:17.675940 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f96b91f3-9e17-446a-90e9-cdd5348b3ded tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:17.676750 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f96b91f3-9e17-446a-90e9-cdd5348b3ded tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:17.678028 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f96b91f3-9e17-446a-90e9-cdd5348b3ded tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:17.678969 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f96b91f3-9e17-446a-90e9-cdd5348b3ded tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:17.884035 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f96b91f3-9e17-446a-90e9-cdd5348b3ded tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:17.891810 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f96b91f3-9e17-446a-90e9-cdd5348b3ded tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1521 microversion: 2.1 time: 0.229825 Jun 25 16:07:17.892511 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 66/137] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:17 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:18.908715 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-72b82020-ce06-4fdc-a406-1543f028b4eb tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:18.909417 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-72b82020-ce06-4fdc-a406-1543f028b4eb tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:18.916019 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-72b82020-ce06-4fdc-a406-1543f028b4eb tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:18.916839 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-72b82020-ce06-4fdc-a406-1543f028b4eb tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:18.917601 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-72b82020-ce06-4fdc-a406-1543f028b4eb tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:18.918030 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-72b82020-ce06-4fdc-a406-1543f028b4eb tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:19.063100 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-72b82020-ce06-4fdc-a406-1543f028b4eb tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:19.071730 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-72b82020-ce06-4fdc-a406-1543f028b4eb tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1521 microversion: 2.1 time: 0.166689 Jun 25 16:07:19.072601 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 72/138] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:18 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:20.092138 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c93b0736-e69a-4aa5-8932-9ac753690411 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:20.092822 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c93b0736-e69a-4aa5-8932-9ac753690411 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:20.101184 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c93b0736-e69a-4aa5-8932-9ac753690411 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:20.102056 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c93b0736-e69a-4aa5-8932-9ac753690411 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:20.103016 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c93b0736-e69a-4aa5-8932-9ac753690411 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:20.105810 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c93b0736-e69a-4aa5-8932-9ac753690411 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:20.335217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c93b0736-e69a-4aa5-8932-9ac753690411 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:20.343560 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c93b0736-e69a-4aa5-8932-9ac753690411 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1521 microversion: 2.1 time: 0.257587 Jun 25 16:07:20.354513 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 67/139] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:20 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:20.607436 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-f952f45e-ee6c-410a-9181-69b6a1eadc25 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:20.607955 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-f952f45e-ee6c-410a-9181-69b6a1eadc25 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:20.614006 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f952f45e-ee6c-410a-9181-69b6a1eadc25 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:20.614752 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f952f45e-ee6c-410a-9181-69b6a1eadc25 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:20.615975 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f952f45e-ee6c-410a-9181-69b6a1eadc25 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:20.616733 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f952f45e-ee6c-410a-9181-69b6a1eadc25 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:20.649864 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-f952f45e-ee6c-410a-9181-69b6a1eadc25 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Going to try to terminate instance {{(pid=117794) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 16:07:20.764235 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-f952f45e-ee6c-410a-9181-69b6a1eadc25 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "DELETE /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 204 len: 0 microversion: 2.1 time: 0.159809 Jun 25 16:07:20.765650 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 73/140] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Jun 25 16:07:20 2022] DELETE /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 16:07:20.782708 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-53456e94-c8ea-42e5-b21d-f075ca4d4480 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:20.783331 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-53456e94-c8ea-42e5-b21d-f075ca4d4480 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:20.794676 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-53456e94-c8ea-42e5-b21d-f075ca4d4480 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:20.795137 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-53456e94-c8ea-42e5-b21d-f075ca4d4480 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:20.795914 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-53456e94-c8ea-42e5-b21d-f075ca4d4480 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:20.796348 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-53456e94-c8ea-42e5-b21d-f075ca4d4480 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:21.011976 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-53456e94-c8ea-42e5-b21d-f075ca4d4480 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:21.027239 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-53456e94-c8ea-42e5-b21d-f075ca4d4480 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1554 microversion: 2.1 time: 0.254830 Jun 25 16:07:21.027977 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 68/141] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:20 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1554 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:21.370475 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-b63351b3-31e7-4e3a-8d57-a1cac3b36c28 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:21.373445 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-b63351b3-31e7-4e3a-8d57-a1cac3b36c28 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:21.390444 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b63351b3-31e7-4e3a-8d57-a1cac3b36c28 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:21.390889 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b63351b3-31e7-4e3a-8d57-a1cac3b36c28 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:21.391817 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b63351b3-31e7-4e3a-8d57-a1cac3b36c28 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:21.392247 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b63351b3-31e7-4e3a-8d57-a1cac3b36c28 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:21.613921 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-b63351b3-31e7-4e3a-8d57-a1cac3b36c28 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:21.626139 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-b63351b3-31e7-4e3a-8d57-a1cac3b36c28 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1521 microversion: 2.1 time: 0.267990 Jun 25 16:07:21.627561 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 74/142] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:21 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:22.044504 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7328d2cb-1d8b-47ef-9047-df03bed141ba tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:22.045102 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7328d2cb-1d8b-47ef-9047-df03bed141ba tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:22.051648 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7328d2cb-1d8b-47ef-9047-df03bed141ba tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:22.052096 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7328d2cb-1d8b-47ef-9047-df03bed141ba tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:22.052874 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7328d2cb-1d8b-47ef-9047-df03bed141ba tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:22.053381 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7328d2cb-1d8b-47ef-9047-df03bed141ba tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:22.185471 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7328d2cb-1d8b-47ef-9047-df03bed141ba tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:22.194932 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7328d2cb-1d8b-47ef-9047-df03bed141ba tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1554 microversion: 2.1 time: 0.154218 Jun 25 16:07:22.195752 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 69/143] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:22 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:22.646737 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-9336cddf-438d-4960-b239-202eeb611eda tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:22.646737 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-9336cddf-438d-4960-b239-202eeb611eda tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:22.655211 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9336cddf-438d-4960-b239-202eeb611eda tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:22.655659 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9336cddf-438d-4960-b239-202eeb611eda tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:22.656719 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9336cddf-438d-4960-b239-202eeb611eda tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:22.657484 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9336cddf-438d-4960-b239-202eeb611eda tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:22.914492 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-9336cddf-438d-4960-b239-202eeb611eda tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:22.926011 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-9336cddf-438d-4960-b239-202eeb611eda tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1521 microversion: 2.1 time: 0.284739 Jun 25 16:07:22.926659 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 75/144] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:22 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:07:23.214896 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9b315dd9-b05d-41b0-84bb-22dc688d91f7 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:23.217591 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9b315dd9-b05d-41b0-84bb-22dc688d91f7 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:23.234631 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9b315dd9-b05d-41b0-84bb-22dc688d91f7 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:23.236649 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9b315dd9-b05d-41b0-84bb-22dc688d91f7 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:23.239789 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9b315dd9-b05d-41b0-84bb-22dc688d91f7 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:23.243451 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9b315dd9-b05d-41b0-84bb-22dc688d91f7 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:23.494844 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9b315dd9-b05d-41b0-84bb-22dc688d91f7 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:23.504216 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9b315dd9-b05d-41b0-84bb-22dc688d91f7 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1554 microversion: 2.1 time: 0.294740 Jun 25 16:07:23.505538 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 70/145] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:23 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1554 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:23.947246 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-cb137f7a-32c3-427d-9976-48ec6861e7cd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:23.947874 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-cb137f7a-32c3-427d-9976-48ec6861e7cd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:23.956850 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cb137f7a-32c3-427d-9976-48ec6861e7cd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:23.957311 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cb137f7a-32c3-427d-9976-48ec6861e7cd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:23.958096 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cb137f7a-32c3-427d-9976-48ec6861e7cd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:23.958536 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cb137f7a-32c3-427d-9976-48ec6861e7cd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:24.028610 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-0240982f-f790-4f41-88f4-b3a38075fb81 req-5cbfd06d-cb2a-4694-ac55-44c9ac5003ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01f7cc79-f68f-4fe1-b31e-1cb4f0fea810", "name": "network-vif-deleted", "tag": "da56dc06-e8a5-4eac-a9b3-a873439d682c"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:07:24.051476 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-0240982f-f790-4f41-88f4-b3a38075fb81 req-5cbfd06d-cb2a-4694-ac55-44c9ac5003ba service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:24.052597 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-0240982f-f790-4f41-88f4-b3a38075fb81 req-5cbfd06d-cb2a-4694-ac55-44c9ac5003ba service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:24.085112 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-0240982f-f790-4f41-88f4-b3a38075fb81 req-5cbfd06d-cb2a-4694-ac55-44c9ac5003ba service nova] Creating event network-vif-deleted:da56dc06-e8a5-4eac-a9b3-a873439d682c for instance 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 on hv-cinder-84762 Jun 25 16:07:24.110464 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-0240982f-f790-4f41-88f4-b3a38075fb81 req-5cbfd06d-cb2a-4694-ac55-44c9ac5003ba service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085594 Jun 25 16:07:24.111487 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 71/146] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 16:07:24.237170 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-cb137f7a-32c3-427d-9976-48ec6861e7cd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:24.249167 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-cb137f7a-32c3-427d-9976-48ec6861e7cd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1521 microversion: 2.1 time: 0.305968 Jun 25 16:07:24.259368 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 76/147] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:23 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1521 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:24.527447 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f1d4cb75-f8d3-4e14-be8b-7a4e7ea1f170 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:24.528298 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f1d4cb75-f8d3-4e14-be8b-7a4e7ea1f170 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:24.537331 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f1d4cb75-f8d3-4e14-be8b-7a4e7ea1f170 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:24.537952 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f1d4cb75-f8d3-4e14-be8b-7a4e7ea1f170 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:24.539136 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f1d4cb75-f8d3-4e14-be8b-7a4e7ea1f170 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:24.539577 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f1d4cb75-f8d3-4e14-be8b-7a4e7ea1f170 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:24.596757 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f1d4cb75-f8d3-4e14-be8b-7a4e7ea1f170 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:24.597215 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f1d4cb75-f8d3-4e14-be8b-7a4e7ea1f170 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:24.597682 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-f1d4cb75-f8d3-4e14-be8b-7a4e7ea1f170 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lazy-loading 'fault' on Instance uuid 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 16:07:24.660022 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f1d4cb75-f8d3-4e14-be8b-7a4e7ea1f170 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:24.668395 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f1d4cb75-f8d3-4e14-be8b-7a4e7ea1f170 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1350 microversion: 2.1 time: 0.148586 Jun 25 16:07:24.668998 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 72/148] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:24 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:25.267944 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-2d00550a-422c-4010-9a75-962783de11e4 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:25.268756 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-2d00550a-422c-4010-9a75-962783de11e4 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:25.277435 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2d00550a-422c-4010-9a75-962783de11e4 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:25.278044 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2d00550a-422c-4010-9a75-962783de11e4 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:25.278986 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2d00550a-422c-4010-9a75-962783de11e4 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:25.279572 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2d00550a-422c-4010-9a75-962783de11e4 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:25.529265 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-2d00550a-422c-4010-9a75-962783de11e4 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:25.553829 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-2d00550a-422c-4010-9a75-962783de11e4 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1521 microversion: 2.1 time: 0.289133 Jun 25 16:07:25.565526 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 77/149] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:25 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:25.687362 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-09fa59a1-d5b6-469c-9761-60e006103c7e tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:25.687934 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-09fa59a1-d5b6-469c-9761-60e006103c7e tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:25.696878 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-09fa59a1-d5b6-469c-9761-60e006103c7e tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:25.697513 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-09fa59a1-d5b6-469c-9761-60e006103c7e tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:25.698587 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-09fa59a1-d5b6-469c-9761-60e006103c7e tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:25.699320 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-09fa59a1-d5b6-469c-9761-60e006103c7e tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:25.734415 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-09fa59a1-d5b6-469c-9761-60e006103c7e tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:25.734974 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-09fa59a1-d5b6-469c-9761-60e006103c7e tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:25.735459 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-09fa59a1-d5b6-469c-9761-60e006103c7e tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lazy-loading 'fault' on Instance uuid 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 16:07:25.783923 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-09fa59a1-d5b6-469c-9761-60e006103c7e tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:25.792213 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-09fa59a1-d5b6-469c-9761-60e006103c7e tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1350 microversion: 2.1 time: 0.109946 Jun 25 16:07:25.793081 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 73/150] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:25 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1350 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:07:26.572830 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-535c6e1b-019a-46c1-b20a-51501d8ebb90 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:26.573448 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-535c6e1b-019a-46c1-b20a-51501d8ebb90 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:26.580177 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-535c6e1b-019a-46c1-b20a-51501d8ebb90 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:26.580618 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-535c6e1b-019a-46c1-b20a-51501d8ebb90 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:26.581673 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-535c6e1b-019a-46c1-b20a-51501d8ebb90 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:26.582193 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-535c6e1b-019a-46c1-b20a-51501d8ebb90 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:26.735894 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-535c6e1b-019a-46c1-b20a-51501d8ebb90 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:26.745240 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-535c6e1b-019a-46c1-b20a-51501d8ebb90 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1521 microversion: 2.1 time: 0.176358 Jun 25 16:07:26.746019 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 78/151] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:26 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:26.810421 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7db5128b-11c5-40fc-a860-2dea7177eb5f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:26.810931 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7db5128b-11c5-40fc-a860-2dea7177eb5f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:26.817713 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7db5128b-11c5-40fc-a860-2dea7177eb5f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:26.818178 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7db5128b-11c5-40fc-a860-2dea7177eb5f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:26.818993 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7db5128b-11c5-40fc-a860-2dea7177eb5f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:26.819474 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7db5128b-11c5-40fc-a860-2dea7177eb5f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:26.858481 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7db5128b-11c5-40fc-a860-2dea7177eb5f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:26.859416 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7db5128b-11c5-40fc-a860-2dea7177eb5f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:26.860056 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-7db5128b-11c5-40fc-a860-2dea7177eb5f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lazy-loading 'fault' on Instance uuid 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 16:07:26.910340 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7db5128b-11c5-40fc-a860-2dea7177eb5f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'be06179595ef450a917d71fe4e6b2c5b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c348649c6b794f5c9339ea9506b6a16b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:26.918935 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7db5128b-11c5-40fc-a860-2dea7177eb5f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 200 len: 1350 microversion: 2.1 time: 0.112572 Jun 25 16:07:26.919975 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 74/152] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:26 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 1350 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:27.766001 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-95afa746-ca5e-41b0-87b0-a608d8c6386d tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:27.767406 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-95afa746-ca5e-41b0-87b0-a608d8c6386d tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:27.774609 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-95afa746-ca5e-41b0-87b0-a608d8c6386d tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:27.775070 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-95afa746-ca5e-41b0-87b0-a608d8c6386d tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:27.775998 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-95afa746-ca5e-41b0-87b0-a608d8c6386d tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:27.776577 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-95afa746-ca5e-41b0-87b0-a608d8c6386d tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:27.928098 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-95afa746-ca5e-41b0-87b0-a608d8c6386d tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:27.935969 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-95afa746-ca5e-41b0-87b0-a608d8c6386d tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1521 microversion: 2.1 time: 0.177341 Jun 25 16:07:27.936565 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 79/153] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:27 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:27.946016 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-aa64e006-025f-43b6-b836-6e8d666c094f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:27.946669 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-aa64e006-025f-43b6-b836-6e8d666c094f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:27.954037 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aa64e006-025f-43b6-b836-6e8d666c094f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:27.954482 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aa64e006-025f-43b6-b836-6e8d666c094f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:27.955240 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aa64e006-025f-43b6-b836-6e8d666c094f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:27.955667 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aa64e006-025f-43b6-b836-6e8d666c094f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:27.969935 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-aa64e006-025f-43b6-b836-6e8d666c094f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] HTTP exception thrown: Instance 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 could not be found. Jun 25 16:07:27.982896 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-aa64e006-025f-43b6-b836-6e8d666c094f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Request method failure captured: Jun 25 16:07:27.982896 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 HTTP/1.1 Jun 25 16:07:27.982896 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept: application/json Jun 25 16:07:27.982896 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jun 25 16:07:27.982896 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Connection: close Jun 25 16:07:27.982896 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jun 25 16:07:27.982896 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jun 25 16:07:27.982896 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Host: 10.222.0.13 Jun 25 16:07:27.982896 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jun 25 16:07:27.982896 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jun 25 16:07:27.982896 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABitzJ4cQh7LCXRVdHV0pRKmeZX3NdLV3rmBhu0lJStt51exnfA_YK3JO_tKDXG44aUQ12A714UTt45AWKLzHQXUSCVgnBqtCp0LXaVqjaFNZs4nXWJs9s2kbLOEC-5KxE_NYufpagTeuH5L5xwCNWYxXJYHF4YGxCrAMz_DENzzMU6G2o Jun 25 16:07:27.982896 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jun 25 16:07:27.982896 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jun 25 16:07:27.982896 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jun 25 16:07:27.982896 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jun 25 16:07:27.982896 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jun 25 16:07:27.982896 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jun 25 16:07:27.982896 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Id: c348649c6b794f5c9339ea9506b6a16b Jun 25 16:07:27.982896 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-DeleteServersTestJSON-1607255575 Jun 25 16:07:27.982896 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Role: reader,member Jun 25 16:07:27.982896 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Jun 25 16:07:27.984445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c348649c6b794f5c9339ea9506b6a16b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c348649c6b794f5c9339ea9506b6a16b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c348649c6b794f5c9339ea9506b6a16b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c348649c6b794f5c9339ea9506b6a16b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:07:27.984445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-DeleteServersTestJSON-1607255575 Jun 25 16:07:27.984445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Id: c348649c6b794f5c9339ea9506b6a16b Jun 25 16:07:27.984445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-DeleteServersTestJSON-1607255575 Jun 25 16:07:27.984445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User: tempest-DeleteServersTestJSON-1607255575-project Jun 25 16:07:27.984445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jun 25 16:07:27.984445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jun 25 16:07:27.984445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Id: be06179595ef450a917d71fe4e6b2c5b Jun 25 16:07:27.984445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-DeleteServersTestJSON-1607255575-project Jun 25 16:07:27.984445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: method: > Jun 25 16:07:27.984445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: exception: Instance 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 could not be found. Jun 25 16:07:27.984445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: action_args: {'id': '01f7cc79-f68f-4fe1-b31e-1cb4f0fea810'} Jun 25 16:07:27.985162 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:07:27.985162 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:07:27.985162 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:07:27.985162 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:07:27.985162 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:07:27.985162 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:07:27.985162 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:07:27.985162 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:07:27.985162 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:07:27.985162 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:07:27.985162 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 could not be found. Jun 25 16:07:27.985162 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:07:27.985162 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:07:27.985162 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:07:27.985162 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:07:27.985162 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:07:27.985162 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:07:27.985162 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:07:27.985162 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:07:27.985162 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:07:27.986277 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:07:27.986277 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 16:07:27.986277 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 16:07:27.986277 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:07:27.986277 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:07:27.986277 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:07:27.986277 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:07:27.986277 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 could not be found. Jun 25 16:07:27.986277 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:07:27.986277 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:07:27.986277 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:07:27.986277 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:07:27.986277 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:07:27.986277 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:07:27.986277 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:07:27.986277 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:07:27.986277 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 could not be found. Jun 25 16:07:27.986277 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:07:27.987240 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-aa64e006-025f-43b6-b836-6e8d666c094f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Returning 404 to user: Instance 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:07:27.987240 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-aa64e006-025f-43b6-b836-6e8d666c094f tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 404 len: 111 microversion: 2.1 time: 0.051870 Jun 25 16:07:27.987240 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 75/154] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:27 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 16:07:28.095773 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-0af82f34-6129-49f8-834d-d26422135282 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:28.096739 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-0af82f34-6129-49f8-834d-d26422135282 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:28.102878 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0af82f34-6129-49f8-834d-d26422135282 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:28.103322 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0af82f34-6129-49f8-834d-d26422135282 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:28.104256 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0af82f34-6129-49f8-834d-d26422135282 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:28.104726 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0af82f34-6129-49f8-834d-d26422135282 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:28.117514 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.wsgi [None req-0af82f34-6129-49f8-834d-d26422135282 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] HTTP exception thrown: Instance 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 could not be found. Jun 25 16:07:28.125721 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-0af82f34-6129-49f8-834d-d26422135282 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Request method failure captured: Jun 25 16:07:28.125721 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: request: GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810/os-volume_attachments HTTP/1.1 Jun 25 16:07:28.125721 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept: application/json Jun 25 16:07:28.125721 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept-Encoding: identity Jun 25 16:07:28.125721 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Connection: close Jun 25 16:07:28.125721 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Length: 0 Jun 25 16:07:28.125721 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Type: application/json Jun 25 16:07:28.125721 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Host: 10.222.0.13 Jun 25 16:07:28.125721 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Openstack-System-Scope: None Jun 25 16:07:28.125721 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: User-Agent: python-urllib3/1.26.9 Jun 25 16:07:28.125721 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Auth-Token: gAAAAABitzJ4cQh7LCXRVdHV0pRKmeZX3NdLV3rmBhu0lJStt51exnfA_YK3JO_tKDXG44aUQ12A714UTt45AWKLzHQXUSCVgnBqtCp0LXaVqjaFNZs4nXWJs9s2kbLOEC-5KxE_NYufpagTeuH5L5xwCNWYxXJYHF4YGxCrAMz_DENzzMU6G2o Jun 25 16:07:28.125721 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Id: None Jun 25 16:07:28.125721 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Name: None Jun 25 16:07:28.125721 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Identity-Status: Confirmed Jun 25 16:07:28.125721 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Is-Admin-Project: True Jun 25 16:07:28.125721 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Id: default Jun 25 16:07:28.125721 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Name: Default Jun 25 16:07:28.125721 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Id: c348649c6b794f5c9339ea9506b6a16b Jun 25 16:07:28.125721 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Name: tempest-DeleteServersTestJSON-1607255575 Jun 25 16:07:28.125721 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Role: reader,member Jun 25 16:07:28.125721 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Roles: reader,member Jun 25 16:07:28.126939 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c348649c6b794f5c9339ea9506b6a16b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c348649c6b794f5c9339ea9506b6a16b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c348649c6b794f5c9339ea9506b6a16b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c348649c6b794f5c9339ea9506b6a16b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:07:28.126939 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant: tempest-DeleteServersTestJSON-1607255575 Jun 25 16:07:28.126939 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Id: c348649c6b794f5c9339ea9506b6a16b Jun 25 16:07:28.126939 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Name: tempest-DeleteServersTestJSON-1607255575 Jun 25 16:07:28.126939 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User: tempest-DeleteServersTestJSON-1607255575-project Jun 25 16:07:28.126939 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Id: default Jun 25 16:07:28.126939 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Name: Default Jun 25 16:07:28.126939 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Id: be06179595ef450a917d71fe4e6b2c5b Jun 25 16:07:28.126939 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Name: tempest-DeleteServersTestJSON-1607255575-project Jun 25 16:07:28.126939 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: method: > Jun 25 16:07:28.126939 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: exception: Instance 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 could not be found. Jun 25 16:07:28.126939 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: action_args: {'server_id': '01f7cc79-f68f-4fe1-b31e-1cb4f0fea810'} Jun 25 16:07:28.127559 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:07:28.127559 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:07:28.127559 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:07:28.127559 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:07:28.127559 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:07:28.127559 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:07:28.127559 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:07:28.127559 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:07:28.127559 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:07:28.127559 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:07:28.127559 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 could not be found. Jun 25 16:07:28.127559 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:07:28.127559 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:07:28.127559 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:07:28.127559 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:07:28.127559 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:07:28.127559 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:07:28.127559 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:07:28.127559 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:07:28.127559 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:07:28.128750 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:07:28.128750 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 25 16:07:28.128750 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 16:07:28.128750 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 25 16:07:28.128750 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 16:07:28.128750 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 25 16:07:28.128750 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 25 16:07:28.128750 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:07:28.128750 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:07:28.128750 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 could not be found. Jun 25 16:07:28.128750 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:07:28.128750 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:07:28.128750 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:07:28.128750 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:07:28.128750 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:07:28.128750 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:07:28.128750 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:07:28.128750 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:07:28.128750 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 could not be found. Jun 25 16:07:28.128750 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:07:28.130011 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-0af82f34-6129-49f8-834d-d26422135282 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Returning 404 to user: Instance 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 could not be found. {{(pid=117794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:07:28.130011 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-0af82f34-6129-49f8-834d-d26422135282 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.035359 Jun 25 16:07:28.130011 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 80/155] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Jun 25 16:07:28 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:07:28.958135 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-bdfcdbba-d9f5-4f51-8827-92d7580a13d3 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:28.958941 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-bdfcdbba-d9f5-4f51-8827-92d7580a13d3 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:28.969306 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bdfcdbba-d9f5-4f51-8827-92d7580a13d3 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:28.970205 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bdfcdbba-d9f5-4f51-8827-92d7580a13d3 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:28.971352 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bdfcdbba-d9f5-4f51-8827-92d7580a13d3 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:28.972256 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bdfcdbba-d9f5-4f51-8827-92d7580a13d3 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:29.126485 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-bdfcdbba-d9f5-4f51-8827-92d7580a13d3 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:29.137377 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-bdfcdbba-d9f5-4f51-8827-92d7580a13d3 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1521 microversion: 2.1 time: 0.183830 Jun 25 16:07:29.138164 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 76/156] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:28 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:29.327127 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-0f2a0081-d3f2-432b-a7bf-3478eff1aa48 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:29.327729 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-0f2a0081-d3f2-432b-a7bf-3478eff1aa48 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:29.334951 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0f2a0081-d3f2-432b-a7bf-3478eff1aa48 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:29.335425 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0f2a0081-d3f2-432b-a7bf-3478eff1aa48 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:29.336346 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0f2a0081-d3f2-432b-a7bf-3478eff1aa48 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:29.336971 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0f2a0081-d3f2-432b-a7bf-3478eff1aa48 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:29.353139 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.wsgi [None req-0f2a0081-d3f2-432b-a7bf-3478eff1aa48 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] HTTP exception thrown: Instance 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 could not be found. Jun 25 16:07:29.355283 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-0f2a0081-d3f2-432b-a7bf-3478eff1aa48 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Request method failure captured: Jun 25 16:07:29.355283 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: request: DELETE /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 HTTP/1.1 Jun 25 16:07:29.355283 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept: application/json Jun 25 16:07:29.355283 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept-Encoding: identity Jun 25 16:07:29.355283 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Connection: close Jun 25 16:07:29.355283 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Length: 0 Jun 25 16:07:29.355283 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Type: application/json Jun 25 16:07:29.355283 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Host: 10.222.0.13 Jun 25 16:07:29.355283 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Openstack-System-Scope: None Jun 25 16:07:29.355283 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: User-Agent: python-urllib3/1.26.9 Jun 25 16:07:29.355283 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Auth-Token: gAAAAABitzJ4cQh7LCXRVdHV0pRKmeZX3NdLV3rmBhu0lJStt51exnfA_YK3JO_tKDXG44aUQ12A714UTt45AWKLzHQXUSCVgnBqtCp0LXaVqjaFNZs4nXWJs9s2kbLOEC-5KxE_NYufpagTeuH5L5xwCNWYxXJYHF4YGxCrAMz_DENzzMU6G2o Jun 25 16:07:29.355283 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Id: None Jun 25 16:07:29.355283 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Name: None Jun 25 16:07:29.355283 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Identity-Status: Confirmed Jun 25 16:07:29.355283 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Is-Admin-Project: True Jun 25 16:07:29.355283 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Id: default Jun 25 16:07:29.355283 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Name: Default Jun 25 16:07:29.355283 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Id: c348649c6b794f5c9339ea9506b6a16b Jun 25 16:07:29.355283 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Name: tempest-DeleteServersTestJSON-1607255575 Jun 25 16:07:29.355283 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Role: reader,member Jun 25 16:07:29.355283 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Roles: reader,member Jun 25 16:07:29.356729 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c348649c6b794f5c9339ea9506b6a16b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c348649c6b794f5c9339ea9506b6a16b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c348649c6b794f5c9339ea9506b6a16b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c348649c6b794f5c9339ea9506b6a16b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:07:29.356729 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant: tempest-DeleteServersTestJSON-1607255575 Jun 25 16:07:29.356729 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Id: c348649c6b794f5c9339ea9506b6a16b Jun 25 16:07:29.356729 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Name: tempest-DeleteServersTestJSON-1607255575 Jun 25 16:07:29.356729 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User: tempest-DeleteServersTestJSON-1607255575-project Jun 25 16:07:29.356729 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Id: default Jun 25 16:07:29.356729 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Name: Default Jun 25 16:07:29.356729 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Id: be06179595ef450a917d71fe4e6b2c5b Jun 25 16:07:29.356729 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Name: tempest-DeleteServersTestJSON-1607255575-project Jun 25 16:07:29.356729 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: method: > Jun 25 16:07:29.356729 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: exception: Instance 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 could not be found. Jun 25 16:07:29.356729 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: action_args: {'id': '01f7cc79-f68f-4fe1-b31e-1cb4f0fea810'} Jun 25 16:07:29.357573 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:07:29.357573 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:07:29.357573 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:07:29.357573 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:07:29.357573 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:07:29.357573 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:07:29.357573 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:07:29.357573 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:07:29.357573 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:07:29.357573 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:07:29.357573 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 could not be found. Jun 25 16:07:29.357573 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:07:29.357573 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:07:29.357573 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:07:29.357573 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:07:29.357573 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:07:29.357573 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:07:29.357573 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:07:29.357573 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:07:29.357573 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:07:29.358777 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:07:29.358777 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 16:07:29.358777 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 16:07:29.358777 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 16:07:29.358777 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 16:07:29.358777 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:07:29.358777 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:07:29.358777 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:07:29.358777 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:07:29.358777 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 could not be found. Jun 25 16:07:29.358777 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:07:29.358777 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:07:29.358777 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:07:29.358777 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:07:29.358777 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:07:29.358777 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:07:29.358777 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:07:29.358777 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:07:29.358777 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 could not be found. Jun 25 16:07:29.358777 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:07:29.360007 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-0f2a0081-d3f2-432b-a7bf-3478eff1aa48 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Returning 404 to user: Instance 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 could not be found. {{(pid=117794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:07:29.360007 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-0f2a0081-d3f2-432b-a7bf-3478eff1aa48 tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "DELETE /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 404 len: 111 microversion: 2.1 time: 0.034043 Jun 25 16:07:29.360007 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 81/157] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Jun 25 16:07:29 2022] DELETE /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:07:29.365670 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3b953c8f-5b9e-4d15-9975-3f5cbffcfcfc tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:29.366282 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3b953c8f-5b9e-4d15-9975-3f5cbffcfcfc tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] [instance: 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:29.372189 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3b953c8f-5b9e-4d15-9975-3f5cbffcfcfc tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:29.372734 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3b953c8f-5b9e-4d15-9975-3f5cbffcfcfc tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:29.373643 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3b953c8f-5b9e-4d15-9975-3f5cbffcfcfc tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:29.374079 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3b953c8f-5b9e-4d15-9975-3f5cbffcfcfc tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:29.389207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-3b953c8f-5b9e-4d15-9975-3f5cbffcfcfc tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] HTTP exception thrown: Instance 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 could not be found. Jun 25 16:07:29.391035 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3b953c8f-5b9e-4d15-9975-3f5cbffcfcfc tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Request method failure captured: Jun 25 16:07:29.391035 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 HTTP/1.1 Jun 25 16:07:29.391035 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept: application/json Jun 25 16:07:29.391035 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jun 25 16:07:29.391035 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Connection: close Jun 25 16:07:29.391035 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jun 25 16:07:29.391035 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jun 25 16:07:29.391035 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Host: 10.222.0.13 Jun 25 16:07:29.391035 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jun 25 16:07:29.391035 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jun 25 16:07:29.391035 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABitzJ4cQh7LCXRVdHV0pRKmeZX3NdLV3rmBhu0lJStt51exnfA_YK3JO_tKDXG44aUQ12A714UTt45AWKLzHQXUSCVgnBqtCp0LXaVqjaFNZs4nXWJs9s2kbLOEC-5KxE_NYufpagTeuH5L5xwCNWYxXJYHF4YGxCrAMz_DENzzMU6G2o Jun 25 16:07:29.391035 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jun 25 16:07:29.391035 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jun 25 16:07:29.391035 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jun 25 16:07:29.391035 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jun 25 16:07:29.391035 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jun 25 16:07:29.391035 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jun 25 16:07:29.391035 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Id: c348649c6b794f5c9339ea9506b6a16b Jun 25 16:07:29.391035 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-DeleteServersTestJSON-1607255575 Jun 25 16:07:29.391035 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Role: reader,member Jun 25 16:07:29.391035 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Jun 25 16:07:29.392387 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c348649c6b794f5c9339ea9506b6a16b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c348649c6b794f5c9339ea9506b6a16b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c348649c6b794f5c9339ea9506b6a16b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c348649c6b794f5c9339ea9506b6a16b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:07:29.392387 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-DeleteServersTestJSON-1607255575 Jun 25 16:07:29.392387 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Id: c348649c6b794f5c9339ea9506b6a16b Jun 25 16:07:29.392387 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-DeleteServersTestJSON-1607255575 Jun 25 16:07:29.392387 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User: tempest-DeleteServersTestJSON-1607255575-project Jun 25 16:07:29.392387 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jun 25 16:07:29.392387 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jun 25 16:07:29.392387 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Id: be06179595ef450a917d71fe4e6b2c5b Jun 25 16:07:29.392387 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-DeleteServersTestJSON-1607255575-project Jun 25 16:07:29.392387 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: method: > Jun 25 16:07:29.392387 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: exception: Instance 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 could not be found. Jun 25 16:07:29.392387 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: action_args: {'id': '01f7cc79-f68f-4fe1-b31e-1cb4f0fea810'} Jun 25 16:07:29.393396 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:07:29.393396 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:07:29.393396 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:07:29.393396 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:07:29.393396 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:07:29.393396 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:07:29.393396 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:07:29.393396 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:07:29.393396 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:07:29.393396 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:07:29.393396 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 could not be found. Jun 25 16:07:29.393396 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:07:29.393396 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:07:29.393396 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:07:29.393396 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:07:29.393396 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:07:29.393396 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:07:29.393396 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:07:29.393396 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:07:29.393396 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:07:29.394822 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:07:29.394822 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 16:07:29.394822 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 16:07:29.394822 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:07:29.394822 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:07:29.394822 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:07:29.394822 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:07:29.394822 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 could not be found. Jun 25 16:07:29.394822 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:07:29.394822 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:07:29.394822 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:07:29.394822 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:07:29.394822 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:07:29.394822 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:07:29.394822 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:07:29.394822 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:07:29.394822 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 could not be found. Jun 25 16:07:29.394822 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:07:29.396027 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3b953c8f-5b9e-4d15-9975-3f5cbffcfcfc tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] Returning 404 to user: Instance 01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:07:29.396027 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3b953c8f-5b9e-4d15-9975-3f5cbffcfcfc tempest-DeleteServersTestJSON-1607255575 tempest-DeleteServersTestJSON-1607255575-project] 10.222.0.13 "GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810" status: 404 len: 111 microversion: 2.1 time: 0.030864 Jun 25 16:07:29.396027 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 77/158] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:29 2022] GET /compute/v2.1/servers/01f7cc79-f68f-4fe1-b31e-1cb4f0fea810 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:07:30.155159 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-60388a94-a172-4abb-9665-be930a26f90d tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:30.155758 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-60388a94-a172-4abb-9665-be930a26f90d tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:30.162813 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-60388a94-a172-4abb-9665-be930a26f90d tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:30.165724 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-60388a94-a172-4abb-9665-be930a26f90d tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:30.167656 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-60388a94-a172-4abb-9665-be930a26f90d tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:30.168921 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-60388a94-a172-4abb-9665-be930a26f90d tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:30.460075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-60388a94-a172-4abb-9665-be930a26f90d tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:30.482400 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-60388a94-a172-4abb-9665-be930a26f90d tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1521 microversion: 2.1 time: 0.330969 Jun 25 16:07:30.491787 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 82/159] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:30 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1521 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:31.509017 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d773f979-4b63-47fb-9003-daff96ef3c3c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:31.509633 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d773f979-4b63-47fb-9003-daff96ef3c3c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:31.517861 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d773f979-4b63-47fb-9003-daff96ef3c3c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:31.518307 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d773f979-4b63-47fb-9003-daff96ef3c3c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:31.520436 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d773f979-4b63-47fb-9003-daff96ef3c3c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:31.520891 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d773f979-4b63-47fb-9003-daff96ef3c3c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:31.571973 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=100 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:07:31.852971 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d773f979-4b63-47fb-9003-daff96ef3c3c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:31.871785 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d773f979-4b63-47fb-9003-daff96ef3c3c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1521 microversion: 2.1 time: 0.367358 Jun 25 16:07:31.878838 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 78/160] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:31 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:32.895903 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-4171294d-a08e-4452-91f4-8490fc925dcf tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:32.896722 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-4171294d-a08e-4452-91f4-8490fc925dcf tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:32.913960 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4171294d-a08e-4452-91f4-8490fc925dcf tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:32.914869 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4171294d-a08e-4452-91f4-8490fc925dcf tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:32.916311 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4171294d-a08e-4452-91f4-8490fc925dcf tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:32.918032 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4171294d-a08e-4452-91f4-8490fc925dcf tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:33.256172 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-4171294d-a08e-4452-91f4-8490fc925dcf tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:33.287503 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-4171294d-a08e-4452-91f4-8490fc925dcf tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1521 microversion: 2.1 time: 0.396153 Jun 25 16:07:33.289096 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 83/161] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:32 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1521 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:34.308447 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2f4a46be-73b9-432e-bce0-99c4a0f7c218 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:34.309367 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2f4a46be-73b9-432e-bce0-99c4a0f7c218 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:34.318622 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f4a46be-73b9-432e-bce0-99c4a0f7c218 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:34.319258 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f4a46be-73b9-432e-bce0-99c4a0f7c218 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:34.320158 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f4a46be-73b9-432e-bce0-99c4a0f7c218 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:34.320673 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f4a46be-73b9-432e-bce0-99c4a0f7c218 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:34.542564 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2f4a46be-73b9-432e-bce0-99c4a0f7c218 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:34.550348 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2f4a46be-73b9-432e-bce0-99c4a0f7c218 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1521 microversion: 2.1 time: 0.249431 Jun 25 16:07:34.554968 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 79/162] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:34 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:07:35.569483 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-c6463f7f-9475-4bd2-89fc-23f9b9aa5a11 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:35.570989 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-c6463f7f-9475-4bd2-89fc-23f9b9aa5a11 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:35.582855 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-c6463f7f-9475-4bd2-89fc-23f9b9aa5a11 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:35.583421 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-c6463f7f-9475-4bd2-89fc-23f9b9aa5a11 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:35.584678 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-c6463f7f-9475-4bd2-89fc-23f9b9aa5a11 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:35.585575 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-c6463f7f-9475-4bd2-89fc-23f9b9aa5a11 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:35.750643 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-c6463f7f-9475-4bd2-89fc-23f9b9aa5a11 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:35.761264 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-c6463f7f-9475-4bd2-89fc-23f9b9aa5a11 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1521 microversion: 2.1 time: 0.196296 Jun 25 16:07:35.762000 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 84/163] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:35 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:36.778807 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-404c1966-6c2c-4558-a936-2dab4b91d097 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:36.779478 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-404c1966-6c2c-4558-a936-2dab4b91d097 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:36.791935 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-404c1966-6c2c-4558-a936-2dab4b91d097 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:36.792197 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-404c1966-6c2c-4558-a936-2dab4b91d097 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:36.793004 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-404c1966-6c2c-4558-a936-2dab4b91d097 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:36.793439 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-404c1966-6c2c-4558-a936-2dab4b91d097 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:37.123029 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-404c1966-6c2c-4558-a936-2dab4b91d097 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:37.130543 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-404c1966-6c2c-4558-a936-2dab4b91d097 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1521 microversion: 2.1 time: 0.355462 Jun 25 16:07:37.142790 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 80/164] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:36 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1521 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:38.157137 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-1842ada8-8236-401f-8aec-dec936d4f1f8 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:38.158587 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-1842ada8-8236-401f-8aec-dec936d4f1f8 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:38.168691 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:07:38.179391 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1842ada8-8236-401f-8aec-dec936d4f1f8 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:38.180065 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1842ada8-8236-401f-8aec-dec936d4f1f8 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:38.181115 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1842ada8-8236-401f-8aec-dec936d4f1f8 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:38.181871 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1842ada8-8236-401f-8aec-dec936d4f1f8 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:38.191284 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:07:38.522576 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-1842ada8-8236-401f-8aec-dec936d4f1f8 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:38.531719 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-1842ada8-8236-401f-8aec-dec936d4f1f8 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1501 microversion: 2.1 time: 0.380011 Jun 25 16:07:38.551082 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-62233ff8-8228-469e-a355-ed515246b036 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:38.551685 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-62233ff8-8228-469e-a355-ed515246b036 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 7feaccc2-e2e8-4644-87a9-4b88cd8767d5] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:38.556687 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 85/165] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:38 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1501 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:38.559285 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-62233ff8-8228-469e-a355-ed515246b036 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:38.559921 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-62233ff8-8228-469e-a355-ed515246b036 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:38.560904 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-62233ff8-8228-469e-a355-ed515246b036 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:38.574740 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-62233ff8-8228-469e-a355-ed515246b036 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:38.919426 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-62233ff8-8228-469e-a355-ed515246b036 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:38.931787 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-62233ff8-8228-469e-a355-ed515246b036 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5" status: 200 len: 1515 microversion: 2.1 time: 0.385575 Jun 25 16:07:38.946081 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 81/166] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:38 2022] GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5 => generated 1515 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:40.815594 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-cedec068-fdf1-4538-a0c8-a37ff20047b5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:07:40.817263 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-cedec068-fdf1-4538-a0c8-a37ff20047b5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 7feaccc2-e2e8-4644-87a9-4b88cd8767d5] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:40.830754 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cedec068-fdf1-4538-a0c8-a37ff20047b5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:40.833825 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cedec068-fdf1-4538-a0c8-a37ff20047b5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:40.835853 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cedec068-fdf1-4538-a0c8-a37ff20047b5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:40.837557 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cedec068-fdf1-4538-a0c8-a37ff20047b5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:40.893748 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.objects.instance [None req-cedec068-fdf1-4538-a0c8-a37ff20047b5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lazy-loading 'flavor' on Instance uuid 7feaccc2-e2e8-4644-87a9-4b88cd8767d5 {{(pid=117794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 16:07:41.026587 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-cedec068-fdf1-4538-a0c8-a37ff20047b5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "POST /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5/action" status: 200 len: 32 microversion: 2.1 time: 0.215501 Jun 25 16:07:41.028589 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 86/167] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Jun 25 16:07:40 2022] POST /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5/action => generated 32 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 16:07:41.037750 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-cd781625-f3a9-4350-9b0f-49dc58115176 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:41.038937 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-cd781625-f3a9-4350-9b0f-49dc58115176 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 7feaccc2-e2e8-4644-87a9-4b88cd8767d5] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:41.047588 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cd781625-f3a9-4350-9b0f-49dc58115176 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:41.050588 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cd781625-f3a9-4350-9b0f-49dc58115176 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:41.051966 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cd781625-f3a9-4350-9b0f-49dc58115176 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:41.053038 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cd781625-f3a9-4350-9b0f-49dc58115176 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:41.526191 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-cd781625-f3a9-4350-9b0f-49dc58115176 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:41.538910 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-cd781625-f3a9-4350-9b0f-49dc58115176 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5" status: 200 len: 1521 microversion: 2.1 time: 0.505097 Jun 25 16:07:41.539506 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 82/168] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:41 2022] GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5 => generated 1521 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:42.561605 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-a2319d4f-b0ec-4577-8fc6-f245d1e638d1 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:42.571927 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-a2319d4f-b0ec-4577-8fc6-f245d1e638d1 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 7feaccc2-e2e8-4644-87a9-4b88cd8767d5] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:42.642236 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a2319d4f-b0ec-4577-8fc6-f245d1e638d1 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:42.642700 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a2319d4f-b0ec-4577-8fc6-f245d1e638d1 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:42.643486 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a2319d4f-b0ec-4577-8fc6-f245d1e638d1 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:42.656808 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a2319d4f-b0ec-4577-8fc6-f245d1e638d1 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:43.077279 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-a2319d4f-b0ec-4577-8fc6-f245d1e638d1 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:43.087061 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-a2319d4f-b0ec-4577-8fc6-f245d1e638d1 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5" status: 200 len: 1521 microversion: 2.1 time: 0.532852 Jun 25 16:07:43.097105 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 87/169] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:42 2022] GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5 => generated 1521 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:43.693237 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1c257831-e5d9-4543-b0a9-71e54dade688 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Action: 'create', calling method: .version_select at 0x7f65c023f9d0>, body: {"keypair": {"name": "tempest-keypair-1531379064", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBPnzrC05BN1Bz0Zyo7aHNZB3N+P1jMnhqH509zCV2X7/IoK+xVkc46Q0lrHzEbUx+JaXd7KFjBMQ3Q6ywD13rkSCm83mwWCGpJ8fgH1AZSSsaCr+kBdCacM4Ttt2SaUiA=="}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:07:43.702456 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=44 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:07:43.716614 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-1c257831-e5d9-4543-b0a9-71e54dade688 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Getting quotas for project 0da9a82039c24056beec4b61f533eaa2. Resources: {'key_pairs'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:07:43.721490 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-1c257831-e5d9-4543-b0a9-71e54dade688 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Getting quotas for user 744eb9d4e7084b7e9cae36d5de67f0f0 and project 0da9a82039c24056beec4b61f533eaa2. Resources: {'key_pairs'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:07:43.759083 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1c257831-e5d9-4543-b0a9-71e54dade688 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.552305 Jun 25 16:07:43.760119 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 83/170] 10.222.0.13 () {62 vars in 1199 bytes} [Sat Jun 25 16:07:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 554 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 25 16:07:44.105486 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-6c3cff9c-8bb9-46d1-a07b-dd0bc327ae55 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:44.106642 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-6c3cff9c-8bb9-46d1-a07b-dd0bc327ae55 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 7feaccc2-e2e8-4644-87a9-4b88cd8767d5] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:44.122520 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6c3cff9c-8bb9-46d1-a07b-dd0bc327ae55 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:44.123269 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6c3cff9c-8bb9-46d1-a07b-dd0bc327ae55 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:44.124942 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6c3cff9c-8bb9-46d1-a07b-dd0bc327ae55 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:44.125595 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6c3cff9c-8bb9-46d1-a07b-dd0bc327ae55 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:44.407022 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-6c3cff9c-8bb9-46d1-a07b-dd0bc327ae55 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:44.424922 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-6c3cff9c-8bb9-46d1-a07b-dd0bc327ae55 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5" status: 200 len: 1521 microversion: 2.1 time: 0.323476 Jun 25 16:07:44.425816 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 88/171] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:44 2022] GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:45.442671 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e0360aa1-af41-4c58-8517-23b3282d0835 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:45.444312 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e0360aa1-af41-4c58-8517-23b3282d0835 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 7feaccc2-e2e8-4644-87a9-4b88cd8767d5] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:45.462905 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0360aa1-af41-4c58-8517-23b3282d0835 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:45.464867 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0360aa1-af41-4c58-8517-23b3282d0835 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:45.467506 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0360aa1-af41-4c58-8517-23b3282d0835 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:45.468424 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0360aa1-af41-4c58-8517-23b3282d0835 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:46.073270 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e0360aa1-af41-4c58-8517-23b3282d0835 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:46.088035 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e0360aa1-af41-4c58-8517-23b3282d0835 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5" status: 200 len: 1521 microversion: 2.1 time: 0.649357 Jun 25 16:07:46.101473 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 84/172] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:45 2022] GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5 => generated 1521 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:07:47.109398 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-b2d07286-ffb7-4000-bfa0-e8208b50bec8 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:47.111217 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-b2d07286-ffb7-4000-bfa0-e8208b50bec8 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 7feaccc2-e2e8-4644-87a9-4b88cd8767d5] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:47.124571 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b2d07286-ffb7-4000-bfa0-e8208b50bec8 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:47.125202 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b2d07286-ffb7-4000-bfa0-e8208b50bec8 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:47.126557 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b2d07286-ffb7-4000-bfa0-e8208b50bec8 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:47.126999 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b2d07286-ffb7-4000-bfa0-e8208b50bec8 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:48.251244 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-b2d07286-ffb7-4000-bfa0-e8208b50bec8 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:48.261821 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-b2d07286-ffb7-4000-bfa0-e8208b50bec8 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5" status: 200 len: 1521 microversion: 2.1 time: 1.157054 Jun 25 16:07:48.271857 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 89/173] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:47 2022] GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5 => generated 1521 bytes in 1168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:48.917992 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e46c5297-679b-4a4c-ad0c-1af1a2a0e9b9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1717193156", "imageRef": "84c164fa-276d-4693-b7a0-24fd3024b359", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6882a8e8-9f13-47a2-87c9-a1eafb973bf6"}], "security_groups": [{"name": "tempest-securitygroup--99707745"}], "key_name": "tempest-keypair-1531379064", "user_data": "}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:07:49.108817 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-e46c5297-679b-4a4c-ad0c-1af1a2a0e9b9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] validate_networks() for [('6882a8e8-9f13-47a2-87c9-a1eafb973bf6', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 16:07:49.280172 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-7d7c50b8-3cd5-4990-844d-4c7dcc83fc72 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:49.280820 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-7d7c50b8-3cd5-4990-844d-4c7dcc83fc72 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 7feaccc2-e2e8-4644-87a9-4b88cd8767d5] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:49.295777 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7d7c50b8-3cd5-4990-844d-4c7dcc83fc72 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:49.296229 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7d7c50b8-3cd5-4990-844d-4c7dcc83fc72 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:49.297243 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7d7c50b8-3cd5-4990-844d-4c7dcc83fc72 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:49.297877 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7d7c50b8-3cd5-4990-844d-4c7dcc83fc72 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:49.624626 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-7d7c50b8-3cd5-4990-844d-4c7dcc83fc72 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:49.634418 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-7d7c50b8-3cd5-4990-844d-4c7dcc83fc72 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5" status: 200 len: 1521 microversion: 2.1 time: 0.358428 Jun 25 16:07:49.647634 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 90/174] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:49 2022] GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5 => generated 1521 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:49.898189 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-e46c5297-679b-4a4c-ad0c-1af1a2a0e9b9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 16:07:49.900061 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-e46c5297-679b-4a4c-ad0c-1af1a2a0e9b9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 16:07:49.900965 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-e46c5297-679b-4a4c-ad0c-1af1a2a0e9b9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 16:07:49.901699 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-e46c5297-679b-4a4c-ad0c-1af1a2a0e9b9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 16:07:49.903146 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-e46c5297-679b-4a4c-ad0c-1af1a2a0e9b9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 16:07:49.921845 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e46c5297-679b-4a4c-ad0c-1af1a2a0e9b9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:49.922532 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e46c5297-679b-4a4c-ad0c-1af1a2a0e9b9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:49.924397 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e46c5297-679b-4a4c-ad0c-1af1a2a0e9b9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:49.926258 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e46c5297-679b-4a4c-ad0c-1af1a2a0e9b9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:49.985038 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-e46c5297-679b-4a4c-ad0c-1af1a2a0e9b9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Getting quotas for project 0da9a82039c24056beec4b61f533eaa2. Resources: {'ram', 'cores', 'instances'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:07:49.993020 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-e46c5297-679b-4a4c-ad0c-1af1a2a0e9b9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Getting quotas for user 744eb9d4e7084b7e9cae36d5de67f0f0 and project 0da9a82039c24056beec4b61f533eaa2. Resources: {'ram', 'cores', 'instances'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:07:50.015825 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e46c5297-679b-4a4c-ad0c-1af1a2a0e9b9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 16:07:50.023905 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e46c5297-679b-4a4c-ad0c-1af1a2a0e9b9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84c164fa-276d-4693-b7a0-24fd3024b359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 16:07:50.164146 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e46c5297-679b-4a4c-ad0c-1af1a2a0e9b9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.251255 Jun 25 16:07:50.171529 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 85/175] 10.222.0.13 () {62 vars in 1187 bytes} [Sat Jun 25 16:07:48 2022] POST /compute/v2.1/servers => generated 400 bytes in 1259 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 25 16:07:50.179218 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-6bff49b8-7b01-4333-b965-b52b6cfc42b4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:50.180317 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-6bff49b8-7b01-4333-b965-b52b6cfc42b4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:50.321646 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-6bff49b8-7b01-4333-b965-b52b6cfc42b4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:50.334435 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-6bff49b8-7b01-4333-b965-b52b6cfc42b4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:50.338790 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-6bff49b8-7b01-4333-b965-b52b6cfc42b4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:50.347629 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-6bff49b8-7b01-4333-b965-b52b6cfc42b4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1282 microversion: 2.20 time: 0.169461 Jun 25 16:07:50.350606 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 91/176] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:07:50 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1282 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:07:50.656822 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-bca8f72c-1f85-48cf-99cf-19213071005c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:50.657435 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-bca8f72c-1f85-48cf-99cf-19213071005c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 7feaccc2-e2e8-4644-87a9-4b88cd8767d5] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:50.669408 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bca8f72c-1f85-48cf-99cf-19213071005c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:50.669916 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bca8f72c-1f85-48cf-99cf-19213071005c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:50.670636 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bca8f72c-1f85-48cf-99cf-19213071005c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:50.671063 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bca8f72c-1f85-48cf-99cf-19213071005c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:51.000906 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-bca8f72c-1f85-48cf-99cf-19213071005c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:51.012710 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-bca8f72c-1f85-48cf-99cf-19213071005c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5" status: 200 len: 1521 microversion: 2.1 time: 0.360390 Jun 25 16:07:51.014555 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 86/177] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:50 2022] GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5 => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:51.143462 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-48156225-baa4-4043-88d7-1e059248f633 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1879424318", "imageRef": "84c164fa-276d-4693-b7a0-24fd3024b359", "flavorRef": "452", "networks": [{"uuid": "04d69e79-7a43-49f5-af68-8c7222d567d8"}]}} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:07:51.209562 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.network.neutron [None req-48156225-baa4-4043-88d7-1e059248f633 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] validate_networks() for [('04d69e79-7a43-49f5-af68-8c7222d567d8', None, None, None, None, None)] {{(pid=117794) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 16:07:51.376875 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-be985a1d-a639-4633-ab4a-bb390902d2d2 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:51.377740 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-be985a1d-a639-4633-ab4a-bb390902d2d2 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:51.395680 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be985a1d-a639-4633-ab4a-bb390902d2d2 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:51.396177 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be985a1d-a639-4633-ab4a-bb390902d2d2 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:51.397648 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be985a1d-a639-4633-ab4a-bb390902d2d2 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:51.398095 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be985a1d-a639-4633-ab4a-bb390902d2d2 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:51.531175 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-be985a1d-a639-4633-ab4a-bb390902d2d2 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:51.541505 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-be985a1d-a639-4633-ab4a-bb390902d2d2 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:51.548846 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-be985a1d-a639-4633-ab4a-bb390902d2d2 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:51.551343 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-be985a1d-a639-4633-ab4a-bb390902d2d2 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1334 microversion: 2.20 time: 0.185180 Jun 25 16:07:51.554080 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 87/178] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:07:51 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1334 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:07:51.743959 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-48156225-baa4-4043-88d7-1e059248f633 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Flavor limits 0:0:0 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 16:07:51.745061 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-48156225-baa4-4043-88d7-1e059248f633 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Image limits 0:0:0 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 16:07:51.745537 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-48156225-baa4-4043-88d7-1e059248f633 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Flavor pref 0:0:0 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 16:07:51.746071 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-48156225-baa4-4043-88d7-1e059248f633 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Image pref 0:0:0 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 16:07:51.746654 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-48156225-baa4-4043-88d7-1e059248f633 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 16:07:51.764483 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-48156225-baa4-4043-88d7-1e059248f633 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:51.764483 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-48156225-baa4-4043-88d7-1e059248f633 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:51.764483 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-48156225-baa4-4043-88d7-1e059248f633 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:51.764483 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-48156225-baa4-4043-88d7-1e059248f633 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:51.823682 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.quota [None req-48156225-baa4-4043-88d7-1e059248f633 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Getting quotas for project 4e1e0c6b3e544d138a1c7911cf155076. Resources: {'ram', 'cores', 'instances'} {{(pid=117794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:07:51.833174 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.quota [None req-48156225-baa4-4043-88d7-1e059248f633 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Getting quotas for user bf0332a9562946169ff8a45bf5e6f6f3 and project 4e1e0c6b3e544d138a1c7911cf155076. Resources: {'ram', 'cores', 'instances'} {{(pid=117794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:07:51.864907 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-48156225-baa4-4043-88d7-1e059248f633 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Going to run 1 instances... {{(pid=117794) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 16:07:51.871944 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-48156225-baa4-4043-88d7-1e059248f633 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 51391a15-1b93-4d73-9478-f803e617ca6a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84c164fa-276d-4693-b7a0-24fd3024b359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 16:07:51.949577 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-48156225-baa4-4043-88d7-1e059248f633 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.811518 Jun 25 16:07:51.950230 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 92/179] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Jun 25 16:07:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 16:07:51.965646 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-47c3306b-f0ff-4d51-b669-4f6660c96720 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:51.966279 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-47c3306b-f0ff-4d51-b669-4f6660c96720 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 51391a15-1b93-4d73-9478-f803e617ca6a] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:52.031206 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-2b70f601-51df-449c-bec5-9c8eb8743de7 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:52.031975 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-2b70f601-51df-449c-bec5-9c8eb8743de7 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 7feaccc2-e2e8-4644-87a9-4b88cd8767d5] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:52.046573 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2b70f601-51df-449c-bec5-9c8eb8743de7 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:52.048777 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2b70f601-51df-449c-bec5-9c8eb8743de7 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:52.049578 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2b70f601-51df-449c-bec5-9c8eb8743de7 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:52.050019 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2b70f601-51df-449c-bec5-9c8eb8743de7 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:52.186338 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-47c3306b-f0ff-4d51-b669-4f6660c96720 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:52.206606 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-47c3306b-f0ff-4d51-b669-4f6660c96720 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a" status: 200 len: 1219 microversion: 2.1 time: 0.250096 Jun 25 16:07:52.207645 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 88/180] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:51 2022] GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a => generated 1219 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:52.234673 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-580425de-997b-452f-bb5c-7ac3f4f64679 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:52.235218 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-580425de-997b-452f-bb5c-7ac3f4f64679 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:52.249918 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-580425de-997b-452f-bb5c-7ac3f4f64679 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:52.250382 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-580425de-997b-452f-bb5c-7ac3f4f64679 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:52.254632 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-580425de-997b-452f-bb5c-7ac3f4f64679 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:52.257945 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-580425de-997b-452f-bb5c-7ac3f4f64679 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:52.321451 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-580425de-997b-452f-bb5c-7ac3f4f64679 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f/ips" status: 200 len: 150 microversion: 2.1 time: 0.090128 Jun 25 16:07:52.323567 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 89/181] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Jun 25 16:07:52 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f/ips => generated 150 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:07:52.575758 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-af239032-15b3-43d6-a457-5316d038c1a1 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:52.577796 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-af239032-15b3-43d6-a457-5316d038c1a1 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:52.598451 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-af239032-15b3-43d6-a457-5316d038c1a1 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:52.598908 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-af239032-15b3-43d6-a457-5316d038c1a1 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:52.599809 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-af239032-15b3-43d6-a457-5316d038c1a1 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:52.600366 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-af239032-15b3-43d6-a457-5316d038c1a1 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:53.221260 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-af239032-15b3-43d6-a457-5316d038c1a1 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:53.237833 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-af239032-15b3-43d6-a457-5316d038c1a1 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:53.243668 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-af239032-15b3-43d6-a457-5316d038c1a1 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:53.244913 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-af239032-15b3-43d6-a457-5316d038c1a1 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1340 microversion: 2.20 time: 0.676201 Jun 25 16:07:53.245489 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 90/182] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:07:52 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1340 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:07:53.258813 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c2e0f25b-0e70-4eaf-bb15-0ee7aa73d6a7 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:53.261149 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c2e0f25b-0e70-4eaf-bb15-0ee7aa73d6a7 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 51391a15-1b93-4d73-9478-f803e617ca6a] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:53.290832 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c2e0f25b-0e70-4eaf-bb15-0ee7aa73d6a7 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:53.291281 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c2e0f25b-0e70-4eaf-bb15-0ee7aa73d6a7 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:53.292055 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c2e0f25b-0e70-4eaf-bb15-0ee7aa73d6a7 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:53.292528 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c2e0f25b-0e70-4eaf-bb15-0ee7aa73d6a7 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:53.357938 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-2b70f601-51df-449c-bec5-9c8eb8743de7 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:53.384195 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-2b70f601-51df-449c-bec5-9c8eb8743de7 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5" status: 200 len: 1521 microversion: 2.1 time: 1.349172 Jun 25 16:07:53.394840 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 93/183] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:52 2022] GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5 => generated 1521 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:07:53.405526 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c2e0f25b-0e70-4eaf-bb15-0ee7aa73d6a7 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:53.420480 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c2e0f25b-0e70-4eaf-bb15-0ee7aa73d6a7 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a" status: 200 len: 1271 microversion: 2.1 time: 0.163975 Jun 25 16:07:53.422291 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 91/184] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:53 2022] GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a => generated 1271 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:54.241728 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-5ea720dc-013f-42a9-ad30-b919084998b1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1a2fa49-1d71-4c4e-80d4-0e3478ac3503"}} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:07:54.243002 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-5ea720dc-013f-42a9-ad30-b919084998b1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:54.253597 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5ea720dc-013f-42a9-ad30-b919084998b1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:54.254044 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5ea720dc-013f-42a9-ad30-b919084998b1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:54.261143 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5ea720dc-013f-42a9-ad30-b919084998b1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:54.262703 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5ea720dc-013f-42a9-ad30-b919084998b1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:54.265235 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c23dc661-6a34-4128-9dc1-2eeb262a0ec5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:54.267242 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c23dc661-6a34-4128-9dc1-2eeb262a0ec5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:54.285933 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c23dc661-6a34-4128-9dc1-2eeb262a0ec5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:54.293245 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c23dc661-6a34-4128-9dc1-2eeb262a0ec5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:54.299398 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c23dc661-6a34-4128-9dc1-2eeb262a0ec5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:54.299847 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c23dc661-6a34-4128-9dc1-2eeb262a0ec5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:54.810560 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-5ea720dc-013f-42a9-ad30-b919084998b1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "POST /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.571141 Jun 25 16:07:54.833511 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 94/185] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Jun 25 16:07:54 2022] POST /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f/os-volume_attachments => generated 194 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:07:54.888527 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-7b412013-a4d5-4286-9c17-b999428e4708 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:54.896361 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-7b412013-a4d5-4286-9c17-b999428e4708 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 7feaccc2-e2e8-4644-87a9-4b88cd8767d5] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:54.916598 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c23dc661-6a34-4128-9dc1-2eeb262a0ec5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:54.921186 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7b412013-a4d5-4286-9c17-b999428e4708 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:54.929995 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7b412013-a4d5-4286-9c17-b999428e4708 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:54.930888 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7b412013-a4d5-4286-9c17-b999428e4708 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:54.931846 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c23dc661-6a34-4128-9dc1-2eeb262a0ec5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:54.934718 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7b412013-a4d5-4286-9c17-b999428e4708 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:54.938317 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c23dc661-6a34-4128-9dc1-2eeb262a0ec5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:54.939822 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c23dc661-6a34-4128-9dc1-2eeb262a0ec5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1406 microversion: 2.20 time: 0.680707 Jun 25 16:07:54.940693 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 92/186] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:07:54 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1406 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 16:07:54.971588 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8afbd290-3a93-4d53-aa74-6fce767b960a tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:54.973471 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8afbd290-3a93-4d53-aa74-6fce767b960a tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 51391a15-1b93-4d73-9478-f803e617ca6a] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:54.982773 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8afbd290-3a93-4d53-aa74-6fce767b960a tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:54.983829 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8afbd290-3a93-4d53-aa74-6fce767b960a tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:54.985526 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8afbd290-3a93-4d53-aa74-6fce767b960a tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:54.986149 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8afbd290-3a93-4d53-aa74-6fce767b960a tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:55.218211 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8afbd290-3a93-4d53-aa74-6fce767b960a tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:55.230704 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8afbd290-3a93-4d53-aa74-6fce767b960a tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a" status: 200 len: 1277 microversion: 2.1 time: 0.287301 Jun 25 16:07:55.231505 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 93/187] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:54 2022] GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a => generated 1277 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:55.563559 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-7b412013-a4d5-4286-9c17-b999428e4708 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:55.574011 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-7b412013-a4d5-4286-9c17-b999428e4708 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5" status: 200 len: 1521 microversion: 2.1 time: 0.718382 Jun 25 16:07:55.574599 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 95/188] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:54 2022] GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5 => generated 1521 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:55.960174 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-836a8f1b-64db-4e6a-9bfd-e68e9c499079 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:55.961105 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-836a8f1b-64db-4e6a-9bfd-e68e9c499079 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:55.981308 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-836a8f1b-64db-4e6a-9bfd-e68e9c499079 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:55.983112 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-836a8f1b-64db-4e6a-9bfd-e68e9c499079 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:55.984209 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-836a8f1b-64db-4e6a-9bfd-e68e9c499079 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:55.986221 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-836a8f1b-64db-4e6a-9bfd-e68e9c499079 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:56.250638 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-47724fad-f746-41e2-88c4-09d0f70f91dc tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:56.251429 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-47724fad-f746-41e2-88c4-09d0f70f91dc tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 51391a15-1b93-4d73-9478-f803e617ca6a] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:56.264314 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-47724fad-f746-41e2-88c4-09d0f70f91dc tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:56.267435 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-47724fad-f746-41e2-88c4-09d0f70f91dc tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:56.271124 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-47724fad-f746-41e2-88c4-09d0f70f91dc tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:56.271544 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-47724fad-f746-41e2-88c4-09d0f70f91dc tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:56.678954 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-836a8f1b-64db-4e6a-9bfd-e68e9c499079 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:56.692146 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-836a8f1b-64db-4e6a-9bfd-e68e9c499079 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:56.701553 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-836a8f1b-64db-4e6a-9bfd-e68e9c499079 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:56.703061 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-836a8f1b-64db-4e6a-9bfd-e68e9c499079 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1406 microversion: 2.20 time: 0.748299 Jun 25 16:07:56.712284 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 94/189] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:07:55 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1406 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:07:56.724520 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b5364e1a-6b51-4f90-b12e-55026dd14060 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:56.729387 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b5364e1a-6b51-4f90-b12e-55026dd14060 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 7feaccc2-e2e8-4644-87a9-4b88cd8767d5] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:56.741143 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b5364e1a-6b51-4f90-b12e-55026dd14060 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:56.741508 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-47724fad-f746-41e2-88c4-09d0f70f91dc tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:56.745610 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b5364e1a-6b51-4f90-b12e-55026dd14060 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:56.746461 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b5364e1a-6b51-4f90-b12e-55026dd14060 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:56.748557 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b5364e1a-6b51-4f90-b12e-55026dd14060 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:56.758685 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-47724fad-f746-41e2-88c4-09d0f70f91dc tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a" status: 200 len: 1319 microversion: 2.1 time: 0.510486 Jun 25 16:07:56.760909 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 96/190] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:56 2022] GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a => generated 1319 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:07:56.772042 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-fd85237e-085b-4ca7-bb00-427cb7ecb62a req-239a6ed7-0ce0-45d5-b731-ee7724c29c11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6ae5a58-db83-401e-a158-ebf0981e84ec", "tag": "3115b4bc-8a8e-494e-90f7-66772013aaf5"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:07:56.801959 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-fd85237e-085b-4ca7-bb00-427cb7ecb62a req-239a6ed7-0ce0-45d5-b731-ee7724c29c11 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:56.803650 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-fd85237e-085b-4ca7-bb00-427cb7ecb62a req-239a6ed7-0ce0-45d5-b731-ee7724c29c11 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:56.836693 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-fd85237e-085b-4ca7-bb00-427cb7ecb62a req-239a6ed7-0ce0-45d5-b731-ee7724c29c11 service nova] Creating event network-changed:3115b4bc-8a8e-494e-90f7-66772013aaf5 for instance e6ae5a58-db83-401e-a158-ebf0981e84ec on hv-cinder-84762 Jun 25 16:07:56.849007 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-fd85237e-085b-4ca7-bb00-427cb7ecb62a req-239a6ed7-0ce0-45d5-b731-ee7724c29c11 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086586 Jun 25 16:07:56.850035 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 97/191] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:07:57.058586 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b5364e1a-6b51-4f90-b12e-55026dd14060 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:57.067165 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b5364e1a-6b51-4f90-b12e-55026dd14060 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5" status: 200 len: 1521 microversion: 2.1 time: 0.353173 Jun 25 16:07:57.077651 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 95/192] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:56 2022] GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5 => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:57.733741 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-8a68cb96-5bbe-401c-8e47-b6b7bc54b767 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:57.735170 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-8a68cb96-5bbe-401c-8e47-b6b7bc54b767 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:57.749728 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8a68cb96-5bbe-401c-8e47-b6b7bc54b767 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:57.750468 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8a68cb96-5bbe-401c-8e47-b6b7bc54b767 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:57.751294 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8a68cb96-5bbe-401c-8e47-b6b7bc54b767 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:57.754254 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8a68cb96-5bbe-401c-8e47-b6b7bc54b767 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:57.777204 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-27c56c89-05a4-4d0a-b093-110ade130b99 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:57.777760 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-27c56c89-05a4-4d0a-b093-110ade130b99 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 51391a15-1b93-4d73-9478-f803e617ca6a] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:57.791768 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-27c56c89-05a4-4d0a-b093-110ade130b99 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:57.792223 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-27c56c89-05a4-4d0a-b093-110ade130b99 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:57.793302 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-27c56c89-05a4-4d0a-b093-110ade130b99 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:57.793483 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-27c56c89-05a4-4d0a-b093-110ade130b99 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:58.391150 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-27c56c89-05a4-4d0a-b093-110ade130b99 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:58.405750 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-27c56c89-05a4-4d0a-b093-110ade130b99 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a" status: 200 len: 1319 microversion: 2.1 time: 0.630737 Jun 25 16:07:58.415797 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 96/193] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:57 2022] GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a => generated 1319 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:58.421729 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b17139a8-baa5-4c09-bf90-757546e068d0 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:58.426794 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b17139a8-baa5-4c09-bf90-757546e068d0 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 7feaccc2-e2e8-4644-87a9-4b88cd8767d5] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:58.460834 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b17139a8-baa5-4c09-bf90-757546e068d0 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:58.463823 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b17139a8-baa5-4c09-bf90-757546e068d0 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:58.464802 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b17139a8-baa5-4c09-bf90-757546e068d0 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:58.468144 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b17139a8-baa5-4c09-bf90-757546e068d0 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:58.530946 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-8a68cb96-5bbe-401c-8e47-b6b7bc54b767 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:58.551767 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-8a68cb96-5bbe-401c-8e47-b6b7bc54b767 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:58.553741 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-8a68cb96-5bbe-401c-8e47-b6b7bc54b767 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:58.554910 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-8a68cb96-5bbe-401c-8e47-b6b7bc54b767 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1406 microversion: 2.20 time: 0.833448 Jun 25 16:07:58.568099 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 98/194] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:07:57 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1406 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:07:59.080973 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b17139a8-baa5-4c09-bf90-757546e068d0 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:07:59.096906 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b17139a8-baa5-4c09-bf90-757546e068d0 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5" status: 200 len: 1521 microversion: 2.1 time: 0.681759 Jun 25 16:07:59.097829 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 97/195] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:58 2022] GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5 => generated 1521 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:07:59.424171 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-5e19ce87-c6ba-457e-b9b9-e2104aed010b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:59.424825 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-5e19ce87-c6ba-457e-b9b9-e2104aed010b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 51391a15-1b93-4d73-9478-f803e617ca6a] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:59.435149 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5e19ce87-c6ba-457e-b9b9-e2104aed010b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:59.435657 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5e19ce87-c6ba-457e-b9b9-e2104aed010b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:59.440904 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5e19ce87-c6ba-457e-b9b9-e2104aed010b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:59.441527 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5e19ce87-c6ba-457e-b9b9-e2104aed010b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:59.582695 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-45a80ad8-3aea-4a3f-9edb-f909bbeaaf20 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:07:59.582695 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-45a80ad8-3aea-4a3f-9edb-f909bbeaaf20 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:07:59.589421 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-45a80ad8-3aea-4a3f-9edb-f909bbeaaf20 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:59.589953 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-45a80ad8-3aea-4a3f-9edb-f909bbeaaf20 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:59.590735 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-45a80ad8-3aea-4a3f-9edb-f909bbeaaf20 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:07:59.591168 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-45a80ad8-3aea-4a3f-9edb-f909bbeaaf20 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:07:59.628927 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=100 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:07:59.946900 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:08:00.053721 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-5e19ce87-c6ba-457e-b9b9-e2104aed010b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:00.062593 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-45a80ad8-3aea-4a3f-9edb-f909bbeaaf20 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:00.062811 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-5e19ce87-c6ba-457e-b9b9-e2104aed010b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a" status: 200 len: 1319 microversion: 2.1 time: 0.642622 Jun 25 16:08:00.063475 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 99/196] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:07:59 2022] GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a => generated 1319 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:08:00.092080 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-45a80ad8-3aea-4a3f-9edb-f909bbeaaf20 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:00.093683 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-45a80ad8-3aea-4a3f-9edb-f909bbeaaf20 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:00.094807 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-45a80ad8-3aea-4a3f-9edb-f909bbeaaf20 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1406 microversion: 2.20 time: 0.522994 Jun 25 16:08:00.095362 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 98/197] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:07:59 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1406 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 16:08:00.115104 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e38260a2-7428-46f7-88fb-57741df77597 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:00.115966 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e38260a2-7428-46f7-88fb-57741df77597 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 7feaccc2-e2e8-4644-87a9-4b88cd8767d5] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:00.122921 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e38260a2-7428-46f7-88fb-57741df77597 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:00.123647 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e38260a2-7428-46f7-88fb-57741df77597 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:00.124622 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e38260a2-7428-46f7-88fb-57741df77597 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:00.125219 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e38260a2-7428-46f7-88fb-57741df77597 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:00.338712 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-8f700107-91ba-4404-8818-48e2e9973c1a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Action: 'create', calling method: .version_select at 0x7f65bbf6adc0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1809084523", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGmeMTZZHUY18/U0SsO9M1L75DNJ4taWdLZ3mKMHoUVlA3STWPvMiLlJrjU9nKkT2n8Mp3j68LK3YrqbsbgpAmBShKPZ3Q8kK4uColfdGMwVterZBrWl1YL/3XKBcMuDpw=="}} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:08:00.358398 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.quota [None req-8f700107-91ba-4404-8818-48e2e9973c1a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Getting quotas for project 9b1a552fc6cc43bb80f8a5f951bfcf80. Resources: {'key_pairs'} {{(pid=117794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:08:00.363904 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.quota [None req-8f700107-91ba-4404-8818-48e2e9973c1a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Getting quotas for user 5bd682806c864805a3b410411839ca99 and project 9b1a552fc6cc43bb80f8a5f951bfcf80. Resources: {'key_pairs'} {{(pid=117794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:08:00.408016 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-8f700107-91ba-4404-8818-48e2e9973c1a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.342983 Jun 25 16:08:00.409109 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 100/198] 10.222.0.13 () {60 vars in 1158 bytes} [Sat Jun 25 16:08:00 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:08:00.424323 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e38260a2-7428-46f7-88fb-57741df77597 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:00.425332 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-8012da98-68a8-48bc-ab7c-d5e2f949e259 req-ae422def-68d8-44b2-8a4f-7f661dd0cc4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51391a15-1b93-4d73-9478-f803e617ca6a", "tag": "eb3518e7-515a-4327-8691-c7824f8989cd"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:08:00.434294 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e38260a2-7428-46f7-88fb-57741df77597 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5" status: 200 len: 1521 microversion: 2.1 time: 0.323456 Jun 25 16:08:00.435606 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-8012da98-68a8-48bc-ab7c-d5e2f949e259 req-ae422def-68d8-44b2-8a4f-7f661dd0cc4f service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:00.438674 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-8012da98-68a8-48bc-ab7c-d5e2f949e259 req-ae422def-68d8-44b2-8a4f-7f661dd0cc4f service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:00.446277 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 99/199] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:00 2022] GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5 => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:08:00.455899 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-8012da98-68a8-48bc-ab7c-d5e2f949e259 req-ae422def-68d8-44b2-8a4f-7f661dd0cc4f service nova] Creating event network-changed:eb3518e7-515a-4327-8691-c7824f8989cd for instance 51391a15-1b93-4d73-9478-f803e617ca6a on hv-cinder-84762 Jun 25 16:08:00.462412 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-8012da98-68a8-48bc-ab7c-d5e2f949e259 req-ae422def-68d8-44b2-8a4f-7f661dd0cc4f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052202 Jun 25 16:08:00.463231 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 101/200] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:08:01.102568 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b1de556d-6ba5-4350-aa5e-b1b66926430b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:01.107398 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b1de556d-6ba5-4350-aa5e-b1b66926430b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 51391a15-1b93-4d73-9478-f803e617ca6a] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:01.119300 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-27bc62ac-e2d3-4d0d-96c0-96bec3237dc8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:01.120248 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-27bc62ac-e2d3-4d0d-96c0-96bec3237dc8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:01.151528 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b1de556d-6ba5-4350-aa5e-b1b66926430b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:01.153795 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-27bc62ac-e2d3-4d0d-96c0-96bec3237dc8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:01.154219 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-27bc62ac-e2d3-4d0d-96c0-96bec3237dc8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:01.156603 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b1de556d-6ba5-4350-aa5e-b1b66926430b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:01.157434 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-27bc62ac-e2d3-4d0d-96c0-96bec3237dc8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:01.157895 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-27bc62ac-e2d3-4d0d-96c0-96bec3237dc8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:01.158612 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b1de556d-6ba5-4350-aa5e-b1b66926430b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:01.160689 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b1de556d-6ba5-4350-aa5e-b1b66926430b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:01.210873 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:08:01.711720 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-27bc62ac-e2d3-4d0d-96c0-96bec3237dc8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:01.721883 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b1de556d-6ba5-4350-aa5e-b1b66926430b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:01.724706 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-27bc62ac-e2d3-4d0d-96c0-96bec3237dc8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:01.727845 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-27bc62ac-e2d3-4d0d-96c0-96bec3237dc8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:01.728040 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-27bc62ac-e2d3-4d0d-96c0-96bec3237dc8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1406 microversion: 2.20 time: 0.618135 Jun 25 16:08:01.738380 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 102/201] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:08:01 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1406 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 16:08:01.738709 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b1de556d-6ba5-4350-aa5e-b1b66926430b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a" status: 200 len: 1319 microversion: 2.1 time: 0.650483 Jun 25 16:08:01.738709 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 100/202] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:01 2022] GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a => generated 1319 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:01.744115 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-f94111f9-7f75-4ff1-a7eb-8951d1353e54 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:01.744837 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-f94111f9-7f75-4ff1-a7eb-8951d1353e54 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 7feaccc2-e2e8-4644-87a9-4b88cd8767d5] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:01.751530 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f94111f9-7f75-4ff1-a7eb-8951d1353e54 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:01.752130 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f94111f9-7f75-4ff1-a7eb-8951d1353e54 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:01.753376 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f94111f9-7f75-4ff1-a7eb-8951d1353e54 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:01.754074 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f94111f9-7f75-4ff1-a7eb-8951d1353e54 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:01.807207 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell0:SELECT=2 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:08:01.976093 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-f94111f9-7f75-4ff1-a7eb-8951d1353e54 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:01.987182 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-f94111f9-7f75-4ff1-a7eb-8951d1353e54 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5" status: 200 len: 1501 microversion: 2.1 time: 0.257215 Jun 25 16:08:01.987769 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 103/203] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:01 2022] GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5 => generated 1501 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:02.007117 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-13a7263a-97f5-47ed-b813-131f310b6158 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cbd411c2-4335-4290-aac8-6cb77e8eb3fc"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:08:02.008742 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-13a7263a-97f5-47ed-b813-131f310b6158 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 7feaccc2-e2e8-4644-87a9-4b88cd8767d5] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:02.024877 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-13a7263a-97f5-47ed-b813-131f310b6158 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:02.027398 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-13a7263a-97f5-47ed-b813-131f310b6158 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:02.029766 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-13a7263a-97f5-47ed-b813-131f310b6158 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:02.031709 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-13a7263a-97f5-47ed-b813-131f310b6158 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:02.078902 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-13a7263a-97f5-47ed-b813-131f310b6158 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] HTTP exception thrown: Cannot 'attach_volume' instance 7feaccc2-e2e8-4644-87a9-4b88cd8767d5 while it is in vm_state rescued Jun 25 16:08:02.083759 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-13a7263a-97f5-47ed-b813-131f310b6158 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Request method failure captured: Jun 25 16:08:02.083759 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: request: POST /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5/os-volume_attachments HTTP/1.1 Jun 25 16:08:02.083759 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept: application/json Jun 25 16:08:02.083759 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jun 25 16:08:02.083759 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Connection: close Jun 25 16:08:02.083759 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Length: 74 Jun 25 16:08:02.083759 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jun 25 16:08:02.083759 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Host: 10.222.0.13 Jun 25 16:08:02.083759 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jun 25 16:08:02.083759 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jun 25 16:08:02.083759 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABitzJy2PMEIGjU0D22ICPLrII0pgH6H7ewD2vw5w9vg92aD4-QfJukh_sXEAnvvJYv-lOHCKFN3Jsua1OnxR1mP-RhqYo9qs23StrKXzzDyf_m8VzQ_Av2b07vGTVgZTS2cklgCU5QDM54FSOcZVCDlTXhs3O31jqJozgvouxgWWInUng Jun 25 16:08:02.083759 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jun 25 16:08:02.083759 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jun 25 16:08:02.083759 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jun 25 16:08:02.083759 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jun 25 16:08:02.083759 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jun 25 16:08:02.083759 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jun 25 16:08:02.083759 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Id: 9bcee16336834b80a389799f89b5b79a Jun 25 16:08:02.083759 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1688542009 Jun 25 16:08:02.083759 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Role: reader,member Jun 25 16:08:02.083759 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Jun 25 16:08:02.085355 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9bcee16336834b80a389799f89b5b79a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9bcee16336834b80a389799f89b5b79a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9bcee16336834b80a389799f89b5b79a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9bcee16336834b80a389799f89b5b79a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:08:02.085355 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1688542009 Jun 25 16:08:02.085355 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 9bcee16336834b80a389799f89b5b79a Jun 25 16:08:02.085355 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1688542009 Jun 25 16:08:02.085355 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User: tempest-ServerRescueNegativeTestJSON-1688542009-project Jun 25 16:08:02.085355 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jun 25 16:08:02.085355 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jun 25 16:08:02.085355 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Id: 8a3137566b004edb909d4e3c702a7f59 Jun 25 16:08:02.085355 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1688542009-project Jun 25 16:08:02.085355 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Jun 25 16:08:02.085355 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: {"volumeAttachment": {"volumeId": "cbd411c2-4335-4290-aac8-6cb77e8eb3fc"}} Jun 25 16:08:02.085355 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: method: > Jun 25 16:08:02.086185 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: exception: Cannot 'attach_volume' instance 7feaccc2-e2e8-4644-87a9-4b88cd8767d5 while it is in vm_state rescued Jun 25 16:08:02.086185 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: action_args: {'server_id': '7feaccc2-e2e8-4644-87a9-4b88cd8767d5', 'body': {'volumeAttachment': {'volumeId': 'cbd411c2-4335-4290-aac8-6cb77e8eb3fc'}}} Jun 25 16:08:02.086185 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:08:02.086185 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:08:02.086185 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 25 16:08:02.086185 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 25 16:08:02.086185 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 25 16:08:02.086185 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 16:08:02.086185 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 25 16:08:02.086185 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 25 16:08:02.086185 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7feaccc2-e2e8-4644-87a9-4b88cd8767d5 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 25 16:08:02.086185 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:08:02.086185 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:08:02.086185 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:08:02.086185 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:08:02.086185 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:08:02.086185 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:08:02.086185 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:08:02.086185 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:08:02.087475 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:08:02.087475 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:08:02.087475 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 16:08:02.087475 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 16:08:02.087475 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 16:08:02.087475 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 16:08:02.087475 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 16:08:02.087475 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 16:08:02.087475 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 25 16:08:02.087475 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 25 16:08:02.087475 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 25 16:08:02.087475 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 25 16:08:02.087475 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7feaccc2-e2e8-4644-87a9-4b88cd8767d5 while it is in vm_state rescued Jun 25 16:08:02.087475 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:08:02.087475 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:08:02.087475 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:08:02.087475 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:08:02.087475 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:08:02.087475 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:08:02.088692 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:08:02.088692 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:08:02.088692 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7feaccc2-e2e8-4644-87a9-4b88cd8767d5 while it is in vm_state rescued Jun 25 16:08:02.088692 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:08:02.090694 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-13a7263a-97f5-47ed-b813-131f310b6158 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Returning 409 to user: Cannot 'attach_volume' instance 7feaccc2-e2e8-4644-87a9-4b88cd8767d5 while it is in vm_state rescued {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:08:02.091890 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-13a7263a-97f5-47ed-b813-131f310b6158 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "POST /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.090004 Jun 25 16:08:02.092747 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 101/204] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Jun 25 16:08:02 2022] POST /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5/os-volume_attachments => generated 152 bytes in 91 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 25 16:08:02.103959 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-19f08f67-3c43-4582-9d30-70a5cbefe165 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:08:02.107956 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-19f08f67-3c43-4582-9d30-70a5cbefe165 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 7feaccc2-e2e8-4644-87a9-4b88cd8767d5] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:02.115965 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-19f08f67-3c43-4582-9d30-70a5cbefe165 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:02.116480 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-19f08f67-3c43-4582-9d30-70a5cbefe165 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:02.117308 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-19f08f67-3c43-4582-9d30-70a5cbefe165 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:02.117745 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-19f08f67-3c43-4582-9d30-70a5cbefe165 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:02.208462 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-19f08f67-3c43-4582-9d30-70a5cbefe165 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "POST /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5/action" status: 202 len: 0 microversion: 2.1 time: 0.110018 Jun 25 16:08:02.209523 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 104/205] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Jun 25 16:08:02 2022] POST /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 16:08:02.219300 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c49c8e3b-c90e-475c-b421-ec8ba5968830 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:02.220684 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c49c8e3b-c90e-475c-b421-ec8ba5968830 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 7feaccc2-e2e8-4644-87a9-4b88cd8767d5] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:02.230641 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=12 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:08:02.232863 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c49c8e3b-c90e-475c-b421-ec8ba5968830 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:02.233691 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c49c8e3b-c90e-475c-b421-ec8ba5968830 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:02.234698 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c49c8e3b-c90e-475c-b421-ec8ba5968830 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:02.235267 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c49c8e3b-c90e-475c-b421-ec8ba5968830 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:02.477119 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c49c8e3b-c90e-475c-b421-ec8ba5968830 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:02.485426 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c49c8e3b-c90e-475c-b421-ec8ba5968830 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5" status: 200 len: 1509 microversion: 2.1 time: 0.271910 Jun 25 16:08:02.486490 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 102/206] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:02 2022] GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5 => generated 1509 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:02.749951 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a3496f7b-2180-4ba1-8519-b93b777e705b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:02.750574 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a3496f7b-2180-4ba1-8519-b93b777e705b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 51391a15-1b93-4d73-9478-f803e617ca6a] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:02.753703 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-9b9affbb-61f9-4454-a670-9ea6979348c8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:02.754388 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-9b9affbb-61f9-4454-a670-9ea6979348c8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:02.766696 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a3496f7b-2180-4ba1-8519-b93b777e705b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:02.767200 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a3496f7b-2180-4ba1-8519-b93b777e705b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:02.775212 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9b9affbb-61f9-4454-a670-9ea6979348c8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:02.775667 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9b9affbb-61f9-4454-a670-9ea6979348c8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:02.776486 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9b9affbb-61f9-4454-a670-9ea6979348c8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:02.776927 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9b9affbb-61f9-4454-a670-9ea6979348c8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:02.778482 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a3496f7b-2180-4ba1-8519-b93b777e705b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:02.781202 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a3496f7b-2180-4ba1-8519-b93b777e705b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:03.211272 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a3496f7b-2180-4ba1-8519-b93b777e705b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:03.222796 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a3496f7b-2180-4ba1-8519-b93b777e705b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a" status: 200 len: 1319 microversion: 2.1 time: 0.478877 Jun 25 16:08:03.226062 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 103/207] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:02 2022] GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a => generated 1319 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:03.396891 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-9b9affbb-61f9-4454-a670-9ea6979348c8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:03.405425 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-9b9affbb-61f9-4454-a670-9ea6979348c8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:03.418341 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-9b9affbb-61f9-4454-a670-9ea6979348c8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:03.419677 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-9b9affbb-61f9-4454-a670-9ea6979348c8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1406 microversion: 2.20 time: 0.677309 Jun 25 16:08:03.420474 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 105/208] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:08:02 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1406 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:08:03.505645 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b0d6d6e3-9ba8-4f33-955d-e54de42375de tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:03.506747 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b0d6d6e3-9ba8-4f33-955d-e54de42375de tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 7feaccc2-e2e8-4644-87a9-4b88cd8767d5] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:03.522994 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b0d6d6e3-9ba8-4f33-955d-e54de42375de tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:03.523687 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b0d6d6e3-9ba8-4f33-955d-e54de42375de tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:03.530012 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b0d6d6e3-9ba8-4f33-955d-e54de42375de tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:03.530671 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b0d6d6e3-9ba8-4f33-955d-e54de42375de tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:03.924691 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b0d6d6e3-9ba8-4f33-955d-e54de42375de tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:03.933990 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b0d6d6e3-9ba8-4f33-955d-e54de42375de tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5" status: 200 len: 1509 microversion: 2.1 time: 0.433144 Jun 25 16:08:03.934793 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 104/209] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:03 2022] GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5 => generated 1509 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:04.011709 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-a894e836-ef02-4d9e-aba3-b50edcff8017 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Action: 'create', calling method: .version_select at 0x7f65c01439d0>, body: {"keypair": {"name": "tempest-keypair-2021876115", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4oDWyhzPqBHQTl9j5lPaeLW2bi8WQagCgSuT3Jy4EQGS+ewZjwZTN0fmLBBmm5fukIOkTluI1K3TQm7Uxzmgl/hPGl7iP4LSbwZ13nTXIrAX6uSkS//rJWpxgXw2uq4g=="}} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:08:04.032306 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.quota [None req-a894e836-ef02-4d9e-aba3-b50edcff8017 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Getting quotas for project b1bba8f74dbd433bbffdb2ffbfc481fb. Resources: {'key_pairs'} {{(pid=117794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:08:04.036934 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.quota [None req-a894e836-ef02-4d9e-aba3-b50edcff8017 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Getting quotas for user 19140330ae664e45b85f47f321496191 and project b1bba8f74dbd433bbffdb2ffbfc481fb. Resources: {'key_pairs'} {{(pid=117794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:08:04.080213 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-a894e836-ef02-4d9e-aba3-b50edcff8017 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.074114 Jun 25 16:08:04.081046 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 106/210] 10.222.0.13 () {60 vars in 1158 bytes} [Sat Jun 25 16:08:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:08:04.243661 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-29c88619-b1ec-4c06-9d58-dc539bdbcc82 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:04.245005 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-29c88619-b1ec-4c06-9d58-dc539bdbcc82 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 51391a15-1b93-4d73-9478-f803e617ca6a] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:04.261729 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-29c88619-b1ec-4c06-9d58-dc539bdbcc82 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:04.265878 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-29c88619-b1ec-4c06-9d58-dc539bdbcc82 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:04.266939 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-29c88619-b1ec-4c06-9d58-dc539bdbcc82 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:04.268666 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-29c88619-b1ec-4c06-9d58-dc539bdbcc82 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:04.440277 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-ab4f5a29-937d-45b2-a08d-82139a119298 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:04.441835 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-ab4f5a29-937d-45b2-a08d-82139a119298 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:04.451231 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ab4f5a29-937d-45b2-a08d-82139a119298 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:04.452215 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ab4f5a29-937d-45b2-a08d-82139a119298 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:04.453760 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ab4f5a29-937d-45b2-a08d-82139a119298 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:04.454824 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ab4f5a29-937d-45b2-a08d-82139a119298 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:04.665718 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-29c88619-b1ec-4c06-9d58-dc539bdbcc82 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:04.689553 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-29c88619-b1ec-4c06-9d58-dc539bdbcc82 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a" status: 200 len: 1319 microversion: 2.1 time: 0.450369 Jun 25 16:08:04.690155 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 105/211] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:04 2022] GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a => generated 1319 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:04.869259 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-ab4f5a29-937d-45b2-a08d-82139a119298 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:04.877610 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-ab4f5a29-937d-45b2-a08d-82139a119298 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:04.879132 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-ab4f5a29-937d-45b2-a08d-82139a119298 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:04.881963 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-ab4f5a29-937d-45b2-a08d-82139a119298 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1406 microversion: 2.20 time: 0.447386 Jun 25 16:08:04.882780 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 107/212] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:08:04 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1406 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 16:08:04.954658 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-487f1a07-98b6-481d-b96e-8e6c9957e4bf tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:04.955797 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-487f1a07-98b6-481d-b96e-8e6c9957e4bf tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 7feaccc2-e2e8-4644-87a9-4b88cd8767d5] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:04.965941 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-487f1a07-98b6-481d-b96e-8e6c9957e4bf tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:04.966661 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-487f1a07-98b6-481d-b96e-8e6c9957e4bf tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:04.967663 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-487f1a07-98b6-481d-b96e-8e6c9957e4bf tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:04.968294 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-487f1a07-98b6-481d-b96e-8e6c9957e4bf tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:05.362751 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-487f1a07-98b6-481d-b96e-8e6c9957e4bf tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:05.381408 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-487f1a07-98b6-481d-b96e-8e6c9957e4bf tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5" status: 200 len: 1509 microversion: 2.1 time: 0.430227 Jun 25 16:08:05.384148 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 106/213] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:04 2022] GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5 => generated 1509 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:05.707362 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-6eae09b8-0984-45c0-b1f7-af15d2eff55d tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:05.707930 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-6eae09b8-0984-45c0-b1f7-af15d2eff55d tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 51391a15-1b93-4d73-9478-f803e617ca6a] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:05.718044 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6eae09b8-0984-45c0-b1f7-af15d2eff55d tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:05.718998 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6eae09b8-0984-45c0-b1f7-af15d2eff55d tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:05.720458 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6eae09b8-0984-45c0-b1f7-af15d2eff55d tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:05.722701 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6eae09b8-0984-45c0-b1f7-af15d2eff55d tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:05.901243 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-49e0c7e0-da75-45f1-a208-5d3e4f39e845 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:05.914859 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-49e0c7e0-da75-45f1-a208-5d3e4f39e845 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:05.927037 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-49e0c7e0-da75-45f1-a208-5d3e4f39e845 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:05.927490 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-49e0c7e0-da75-45f1-a208-5d3e4f39e845 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:05.928275 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-49e0c7e0-da75-45f1-a208-5d3e4f39e845 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:05.928772 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-49e0c7e0-da75-45f1-a208-5d3e4f39e845 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:06.149310 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-6eae09b8-0984-45c0-b1f7-af15d2eff55d tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:06.164886 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-6eae09b8-0984-45c0-b1f7-af15d2eff55d tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a" status: 200 len: 1319 microversion: 2.1 time: 0.462188 Jun 25 16:08:06.165462 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 108/214] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:05 2022] GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a => generated 1319 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:06.216130 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-49e0c7e0-da75-45f1-a208-5d3e4f39e845 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:06.225733 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-49e0c7e0-da75-45f1-a208-5d3e4f39e845 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:06.227738 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-49e0c7e0-da75-45f1-a208-5d3e4f39e845 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:06.229240 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-49e0c7e0-da75-45f1-a208-5d3e4f39e845 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1406 microversion: 2.20 time: 0.332947 Jun 25 16:08:06.229948 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 107/215] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:08:05 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1406 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 16:08:06.400682 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-ba6420fd-627a-4799-b66c-c8e209f551f5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:06.401296 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-ba6420fd-627a-4799-b66c-c8e209f551f5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 7feaccc2-e2e8-4644-87a9-4b88cd8767d5] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:06.408733 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ba6420fd-627a-4799-b66c-c8e209f551f5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:06.409483 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ba6420fd-627a-4799-b66c-c8e209f551f5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:06.410515 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ba6420fd-627a-4799-b66c-c8e209f551f5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:06.411903 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ba6420fd-627a-4799-b66c-c8e209f551f5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:06.581642 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-31f3628e-333f-47bb-823b-c7c7aaae39a0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-605005816", "imageRef": "84c164fa-276d-4693-b7a0-24fd3024b359", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "92184934-9929-49a5-91f4-1ab03b25e2f1"}], "security_groups": [{"name": "tempest-securitygroup--986031335"}], "key_name": "tempest-keypair-2021876115", "user_data": "}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:08:06.594618 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-ba6420fd-627a-4799-b66c-c8e209f551f5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:06.604308 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-ba6420fd-627a-4799-b66c-c8e209f551f5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5" status: 200 len: 1509 microversion: 2.1 time: 0.207525 Jun 25 16:08:06.605558 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 109/216] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:06 2022] GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5 => generated 1509 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:06.716269 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-31f3628e-333f-47bb-823b-c7c7aaae39a0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] validate_networks() for [('92184934-9929-49a5-91f4-1ab03b25e2f1', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 16:08:06.750267 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-6d5eb094-2275-447f-9d27-0ecba718ce44 req-ace56a83-5aab-4f6f-b0f3-c07cb251c950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6ae5a58-db83-401e-a158-ebf0981e84ec", "name": "network-vif-plugged", "status": "completed", "tag": "3115b4bc-8a8e-494e-90f7-66772013aaf5"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:08:06.760393 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-6d5eb094-2275-447f-9d27-0ecba718ce44 req-ace56a83-5aab-4f6f-b0f3-c07cb251c950 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:06.761508 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-6d5eb094-2275-447f-9d27-0ecba718ce44 req-ace56a83-5aab-4f6f-b0f3-c07cb251c950 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:06.774465 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-6d5eb094-2275-447f-9d27-0ecba718ce44 req-ace56a83-5aab-4f6f-b0f3-c07cb251c950 service nova] Creating event network-vif-plugged:3115b4bc-8a8e-494e-90f7-66772013aaf5 for instance e6ae5a58-db83-401e-a158-ebf0981e84ec on hv-cinder-84762 Jun 25 16:08:06.779706 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-6d5eb094-2275-447f-9d27-0ecba718ce44 req-ace56a83-5aab-4f6f-b0f3-c07cb251c950 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033208 Jun 25 16:08:06.780705 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 110/217] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:08:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:08:07.146889 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-31f3628e-333f-47bb-823b-c7c7aaae39a0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 16:08:07.147317 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-31f3628e-333f-47bb-823b-c7c7aaae39a0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 16:08:07.148679 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-31f3628e-333f-47bb-823b-c7c7aaae39a0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 16:08:07.149405 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-31f3628e-333f-47bb-823b-c7c7aaae39a0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 16:08:07.150212 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-31f3628e-333f-47bb-823b-c7c7aaae39a0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 16:08:07.164641 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-31f3628e-333f-47bb-823b-c7c7aaae39a0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:07.166261 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-31f3628e-333f-47bb-823b-c7c7aaae39a0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:07.167158 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-31f3628e-333f-47bb-823b-c7c7aaae39a0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:07.170468 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-31f3628e-333f-47bb-823b-c7c7aaae39a0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:07.187087 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-9be7af9b-a522-4ccd-85cc-7f2b87dd0967 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:07.188535 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-9be7af9b-a522-4ccd-85cc-7f2b87dd0967 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 51391a15-1b93-4d73-9478-f803e617ca6a] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:07.190633 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-31f3628e-333f-47bb-823b-c7c7aaae39a0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Getting quotas for project b1bba8f74dbd433bbffdb2ffbfc481fb. Resources: {'ram', 'cores', 'instances'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:08:07.201714 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9be7af9b-a522-4ccd-85cc-7f2b87dd0967 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:07.202706 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9be7af9b-a522-4ccd-85cc-7f2b87dd0967 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:07.205718 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9be7af9b-a522-4ccd-85cc-7f2b87dd0967 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:07.206311 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9be7af9b-a522-4ccd-85cc-7f2b87dd0967 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:07.210978 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-31f3628e-333f-47bb-823b-c7c7aaae39a0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Getting quotas for user 19140330ae664e45b85f47f321496191 and project b1bba8f74dbd433bbffdb2ffbfc481fb. Resources: {'ram', 'cores', 'instances'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:08:07.244140 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-31f3628e-333f-47bb-823b-c7c7aaae39a0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 16:08:07.247386 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-31f3628e-333f-47bb-823b-c7c7aaae39a0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 0d92f23b-4b14-4619-a2c9-a90bd96b27fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84c164fa-276d-4693-b7a0-24fd3024b359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 16:08:07.312500 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-31f3628e-333f-47bb-823b-c7c7aaae39a0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.735959 Jun 25 16:08:07.313510 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 108/218] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Jun 25 16:08:06 2022] POST /compute/v2.1/servers => generated 401 bytes in 738 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 16:08:07.324842 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-efa82a3f-e558-4108-81f9-5e2a8ade5ab8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:07.325610 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-efa82a3f-e558-4108-81f9-5e2a8ade5ab8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:07.333813 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-efa82a3f-e558-4108-81f9-5e2a8ade5ab8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:07.334269 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-efa82a3f-e558-4108-81f9-5e2a8ade5ab8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:07.335050 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-efa82a3f-e558-4108-81f9-5e2a8ade5ab8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:07.335494 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-efa82a3f-e558-4108-81f9-5e2a8ade5ab8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:07.471730 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-9be7af9b-a522-4ccd-85cc-7f2b87dd0967 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:07.492451 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-9be7af9b-a522-4ccd-85cc-7f2b87dd0967 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a" status: 200 len: 1319 microversion: 2.1 time: 0.309718 Jun 25 16:08:07.492451 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 111/219] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:07 2022] GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a => generated 1319 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:08:07.509037 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-423cdfeb-cc23-48d7-8eee-e449a1e4ffa5 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:07.509902 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-423cdfeb-cc23-48d7-8eee-e449a1e4ffa5 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 0d92f23b-4b14-4619-a2c9-a90bd96b27fd] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:07.541412 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-efa82a3f-e558-4108-81f9-5e2a8ade5ab8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:07.557507 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-efa82a3f-e558-4108-81f9-5e2a8ade5ab8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:07.559338 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-efa82a3f-e558-4108-81f9-5e2a8ade5ab8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:07.560510 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-efa82a3f-e558-4108-81f9-5e2a8ade5ab8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1406 microversion: 2.20 time: 0.240381 Jun 25 16:08:07.561069 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 109/220] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:08:07 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:08:07.584593 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-423cdfeb-cc23-48d7-8eee-e449a1e4ffa5 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:07.597520 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-423cdfeb-cc23-48d7-8eee-e449a1e4ffa5 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd" status: 200 len: 1241 microversion: 2.1 time: 0.103336 Jun 25 16:08:07.598106 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 112/221] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:07 2022] GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd => generated 1241 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:07.622960 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a78946be-7d1c-45b8-870a-44433292194e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:07.623632 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a78946be-7d1c-45b8-870a-44433292194e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 7feaccc2-e2e8-4644-87a9-4b88cd8767d5] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:07.630654 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a78946be-7d1c-45b8-870a-44433292194e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:07.631551 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a78946be-7d1c-45b8-870a-44433292194e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:07.632344 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a78946be-7d1c-45b8-870a-44433292194e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:07.632822 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a78946be-7d1c-45b8-870a-44433292194e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:07.806021 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a78946be-7d1c-45b8-870a-44433292194e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:07.813644 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a78946be-7d1c-45b8-870a-44433292194e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5" status: 200 len: 1515 microversion: 2.1 time: 0.195153 Jun 25 16:08:07.814457 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 110/222] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:07 2022] GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5 => generated 1515 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:08.509279 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-9e33c521-5994-4199-8757-507f3130bb2c tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:08.509933 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-9e33c521-5994-4199-8757-507f3130bb2c tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 51391a15-1b93-4d73-9478-f803e617ca6a] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:08.513417 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=5 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:08:08.523017 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9e33c521-5994-4199-8757-507f3130bb2c tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:08.523637 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9e33c521-5994-4199-8757-507f3130bb2c tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:08.524320 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9e33c521-5994-4199-8757-507f3130bb2c tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:08.524957 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9e33c521-5994-4199-8757-507f3130bb2c tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:08.578747 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2ba715d6-4b6d-416c-a808-bd3a0c7e00c3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:08.579642 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2ba715d6-4b6d-416c-a808-bd3a0c7e00c3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:08.583332 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:08:08.587799 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2ba715d6-4b6d-416c-a808-bd3a0c7e00c3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:08.588781 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2ba715d6-4b6d-416c-a808-bd3a0c7e00c3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:08.589813 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2ba715d6-4b6d-416c-a808-bd3a0c7e00c3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:08.590566 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2ba715d6-4b6d-416c-a808-bd3a0c7e00c3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:08.776313 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-9e33c521-5994-4199-8757-507f3130bb2c tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:08.783968 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-9e33c521-5994-4199-8757-507f3130bb2c tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a" status: 200 len: 1319 microversion: 2.1 time: 0.280628 Jun 25 16:08:08.784630 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 113/223] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:08 2022] GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:08.789910 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-4aff8ff2-7877-4f1c-a43d-285083a5797e tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:08.790574 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-4aff8ff2-7877-4f1c-a43d-285083a5797e tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 0d92f23b-4b14-4619-a2c9-a90bd96b27fd] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:08.799952 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4aff8ff2-7877-4f1c-a43d-285083a5797e tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:08.800426 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4aff8ff2-7877-4f1c-a43d-285083a5797e tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:08.801213 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4aff8ff2-7877-4f1c-a43d-285083a5797e tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:08.801639 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4aff8ff2-7877-4f1c-a43d-285083a5797e tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:08.888325 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-4aff8ff2-7877-4f1c-a43d-285083a5797e tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:08.894698 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2ba715d6-4b6d-416c-a808-bd3a0c7e00c3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:08.896750 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-4aff8ff2-7877-4f1c-a43d-285083a5797e tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd" status: 200 len: 1293 microversion: 2.1 time: 0.110560 Jun 25 16:08:08.897369 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 114/224] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:08 2022] GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd => generated 1293 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:08.902061 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-2cbf3a49-9f2e-41ff-912c-9c945abe3e9f req-dbd75387-c6c2-423b-b5e6-c0110f713fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51391a15-1b93-4d73-9478-f803e617ca6a", "name": "network-vif-plugged", "status": "completed", "tag": "eb3518e7-515a-4327-8691-c7824f8989cd"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:08:08.909522 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2ba715d6-4b6d-416c-a808-bd3a0c7e00c3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:08.910441 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-2cbf3a49-9f2e-41ff-912c-9c945abe3e9f req-dbd75387-c6c2-423b-b5e6-c0110f713fc8 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:08.911003 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2ba715d6-4b6d-416c-a808-bd3a0c7e00c3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:08.911130 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-2cbf3a49-9f2e-41ff-912c-9c945abe3e9f req-dbd75387-c6c2-423b-b5e6-c0110f713fc8 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:08.912896 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2ba715d6-4b6d-416c-a808-bd3a0c7e00c3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1406 microversion: 2.20 time: 0.337514 Jun 25 16:08:08.913780 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 111/225] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:08:08 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1406 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:08:08.927826 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-2cbf3a49-9f2e-41ff-912c-9c945abe3e9f req-dbd75387-c6c2-423b-b5e6-c0110f713fc8 service nova] Creating event network-vif-plugged:eb3518e7-515a-4327-8691-c7824f8989cd for instance 51391a15-1b93-4d73-9478-f803e617ca6a on hv-cinder-84762 Jun 25 16:08:08.933894 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-2cbf3a49-9f2e-41ff-912c-9c945abe3e9f req-dbd75387-c6c2-423b-b5e6-c0110f713fc8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035204 Jun 25 16:08:08.934488 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 115/226] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:08:09.316315 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9e59f29a-1537-48a0-bace-8037888cfe7b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Action: 'create', calling method: .version_select at 0x7f65c0185940>, body: {"keypair": {"name": "tempest-keypair-474296034", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAx1re6dTK3Bf0QL6KbIUdpjXt/1p1CvfPo1TPMyV0h/P+T9EJKPleAwln297nDH3ybNdX7/aryby+AX0BKRU9weppFoAAJgP/bIntS3A8jIyeQqHiT1U0EakjZ1DEQLPg=="}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:08:09.359019 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-9e59f29a-1537-48a0-bace-8037888cfe7b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Getting quotas for project 9bcee16336834b80a389799f89b5b79a. Resources: {'key_pairs'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:08:09.367728 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-9e59f29a-1537-48a0-bace-8037888cfe7b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Getting quotas for user 8a3137566b004edb909d4e3c702a7f59 and project 9bcee16336834b80a389799f89b5b79a. Resources: {'key_pairs'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:08:09.409679 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9e59f29a-1537-48a0-bace-8037888cfe7b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.097797 Jun 25 16:08:09.411552 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 112/227] 10.222.0.13 () {60 vars in 1158 bytes} [Sat Jun 25 16:08:09 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:08:09.806799 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-cc9b9c6f-2e81-4487-ae20-cf3dce15402b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:09.807555 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-cc9b9c6f-2e81-4487-ae20-cf3dce15402b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 51391a15-1b93-4d73-9478-f803e617ca6a] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:09.821908 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cc9b9c6f-2e81-4487-ae20-cf3dce15402b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:09.822256 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cc9b9c6f-2e81-4487-ae20-cf3dce15402b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:09.823039 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cc9b9c6f-2e81-4487-ae20-cf3dce15402b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:09.843390 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cc9b9c6f-2e81-4487-ae20-cf3dce15402b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:09.918590 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-453ed4e4-a1e1-4ed5-9b82-914b14ed840d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:09.919342 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-453ed4e4-a1e1-4ed5-9b82-914b14ed840d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 0d92f23b-4b14-4619-a2c9-a90bd96b27fd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:09.937883 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-453ed4e4-a1e1-4ed5-9b82-914b14ed840d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:09.940767 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-453ed4e4-a1e1-4ed5-9b82-914b14ed840d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:09.943856 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-453ed4e4-a1e1-4ed5-9b82-914b14ed840d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:09.951668 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-453ed4e4-a1e1-4ed5-9b82-914b14ed840d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:10.092165 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-453ed4e4-a1e1-4ed5-9b82-914b14ed840d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:10.101326 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-453ed4e4-a1e1-4ed5-9b82-914b14ed840d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd" status: 200 len: 1311 microversion: 2.1 time: 0.189439 Jun 25 16:08:10.101911 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 113/228] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:09 2022] GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd => generated 1311 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:10.119439 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-97cc8c89-c637-408c-bdf8-8ef9274c6ecb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:10.120329 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-97cc8c89-c637-408c-bdf8-8ef9274c6ecb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:10.128779 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-97cc8c89-c637-408c-bdf8-8ef9274c6ecb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:10.129228 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-97cc8c89-c637-408c-bdf8-8ef9274c6ecb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:10.130105 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-97cc8c89-c637-408c-bdf8-8ef9274c6ecb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:10.130585 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-97cc8c89-c637-408c-bdf8-8ef9274c6ecb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:10.254390 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-cc9b9c6f-2e81-4487-ae20-cf3dce15402b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:10.266321 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-cc9b9c6f-2e81-4487-ae20-cf3dce15402b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a" status: 200 len: 1319 microversion: 2.1 time: 0.466116 Jun 25 16:08:10.267364 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 116/229] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:09 2022] GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a => generated 1319 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:08:10.375251 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-97cc8c89-c637-408c-bdf8-8ef9274c6ecb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:10.386403 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-97cc8c89-c637-408c-bdf8-8ef9274c6ecb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:10.388339 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-97cc8c89-c637-408c-bdf8-8ef9274c6ecb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:10.389806 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-97cc8c89-c637-408c-bdf8-8ef9274c6ecb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1598 microversion: 2.20 time: 0.286974 Jun 25 16:08:10.390936 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 114/230] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:08:10 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1598 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:08:10.408839 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-e7c981b9-7943-40fd-b52c-2ed247795368 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:10.409335 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-e7c981b9-7943-40fd-b52c-2ed247795368 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:10.420981 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e7c981b9-7943-40fd-b52c-2ed247795368 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:10.421625 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e7c981b9-7943-40fd-b52c-2ed247795368 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:10.423148 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e7c981b9-7943-40fd-b52c-2ed247795368 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:10.423599 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e7c981b9-7943-40fd-b52c-2ed247795368 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:10.611402 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-e7c981b9-7943-40fd-b52c-2ed247795368 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.207134 Jun 25 16:08:10.614472 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 117/231] 10.222.0.13 () {60 vars in 1315 bytes} [Sat Jun 25 16:08:10 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec/os-interface => generated 285 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 25 16:08:11.120677 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-568c32f4-b3bd-4146-b68a-cb70e241a84a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:11.121297 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-568c32f4-b3bd-4146-b68a-cb70e241a84a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 0d92f23b-4b14-4619-a2c9-a90bd96b27fd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:11.138670 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-568c32f4-b3bd-4146-b68a-cb70e241a84a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:11.139125 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-568c32f4-b3bd-4146-b68a-cb70e241a84a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:11.140218 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-568c32f4-b3bd-4146-b68a-cb70e241a84a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:11.140687 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-568c32f4-b3bd-4146-b68a-cb70e241a84a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:11.285567 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-dac03035-d43b-441b-bd72-403cc4323904 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:11.286778 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-dac03035-d43b-441b-bd72-403cc4323904 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 51391a15-1b93-4d73-9478-f803e617ca6a] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:11.306825 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-568c32f4-b3bd-4146-b68a-cb70e241a84a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:11.314187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-dac03035-d43b-441b-bd72-403cc4323904 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:11.316562 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-568c32f4-b3bd-4146-b68a-cb70e241a84a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd" status: 200 len: 1299 microversion: 2.1 time: 0.200381 Jun 25 16:08:11.318590 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-dac03035-d43b-441b-bd72-403cc4323904 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:11.319080 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 115/232] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:11 2022] GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd => generated 1299 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:11.320123 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-dac03035-d43b-441b-bd72-403cc4323904 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:11.320829 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-dac03035-d43b-441b-bd72-403cc4323904 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:11.636885 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-dac03035-d43b-441b-bd72-403cc4323904 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:11.648124 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-dac03035-d43b-441b-bd72-403cc4323904 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a" status: 200 len: 1319 microversion: 2.1 time: 0.365981 Jun 25 16:08:11.659323 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 118/233] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:11 2022] GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a => generated 1319 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:08:12.340563 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-747576f3-1dd3-4160-98c5-d7f3fdc3b046 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:12.342354 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-747576f3-1dd3-4160-98c5-d7f3fdc3b046 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 0d92f23b-4b14-4619-a2c9-a90bd96b27fd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:12.358806 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-747576f3-1dd3-4160-98c5-d7f3fdc3b046 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:12.361147 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-747576f3-1dd3-4160-98c5-d7f3fdc3b046 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:12.363046 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-747576f3-1dd3-4160-98c5-d7f3fdc3b046 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:12.365050 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-747576f3-1dd3-4160-98c5-d7f3fdc3b046 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:12.621406 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-747576f3-1dd3-4160-98c5-d7f3fdc3b046 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:12.628069 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=100 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:08:12.630799 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-747576f3-1dd3-4160-98c5-d7f3fdc3b046 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd" status: 200 len: 1366 microversion: 2.1 time: 0.298747 Jun 25 16:08:12.631384 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 116/234] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:12 2022] GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:12.671047 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-f68e630a-e812-4b05-b177-5a1b8e6e602a tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:12.671821 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-f68e630a-e812-4b05-b177-5a1b8e6e602a tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 51391a15-1b93-4d73-9478-f803e617ca6a] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:12.684453 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f68e630a-e812-4b05-b177-5a1b8e6e602a tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:12.686264 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f68e630a-e812-4b05-b177-5a1b8e6e602a tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:12.688365 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f68e630a-e812-4b05-b177-5a1b8e6e602a tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:12.689074 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f68e630a-e812-4b05-b177-5a1b8e6e602a tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:13.075354 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-f68e630a-e812-4b05-b177-5a1b8e6e602a tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:13.087387 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-f68e630a-e812-4b05-b177-5a1b8e6e602a tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a" status: 200 len: 1508 microversion: 2.1 time: 0.423974 Jun 25 16:08:13.087973 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 119/235] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:12 2022] GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a => generated 1508 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:13.304101 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-1789d5f9-8bac-4eb9-9b8c-80cdc8193579 req-b71df262-b433-47da-add2-5e1dc01e5a02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d92f23b-4b14-4619-a2c9-a90bd96b27fd", "tag": "dc0159e7-f976-4ca8-a996-a731692f1e35"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:08:13.321341 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-1789d5f9-8bac-4eb9-9b8c-80cdc8193579 req-b71df262-b433-47da-add2-5e1dc01e5a02 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:13.322250 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-1789d5f9-8bac-4eb9-9b8c-80cdc8193579 req-b71df262-b433-47da-add2-5e1dc01e5a02 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:13.385953 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-1789d5f9-8bac-4eb9-9b8c-80cdc8193579 req-b71df262-b433-47da-add2-5e1dc01e5a02 service nova] Creating event network-changed:dc0159e7-f976-4ca8-a996-a731692f1e35 for instance 0d92f23b-4b14-4619-a2c9-a90bd96b27fd on hv-cinder-84762 Jun 25 16:08:13.402957 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-1789d5f9-8bac-4eb9-9b8c-80cdc8193579 req-b71df262-b433-47da-add2-5e1dc01e5a02 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100804 Jun 25 16:08:13.405381 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 117/236] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:08:13.656836 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-d6acf2a8-d125-4648-b06d-707d1125e1c8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:13.657618 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-d6acf2a8-d125-4648-b06d-707d1125e1c8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 0d92f23b-4b14-4619-a2c9-a90bd96b27fd] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:13.674009 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d6acf2a8-d125-4648-b06d-707d1125e1c8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:13.675490 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d6acf2a8-d125-4648-b06d-707d1125e1c8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:13.678575 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d6acf2a8-d125-4648-b06d-707d1125e1c8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:13.680260 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d6acf2a8-d125-4648-b06d-707d1125e1c8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:13.774562 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-e9184f70-fa0b-447a-b528-d703888e4d04 req-74663b4e-dffc-46a8-9e77-73ac092d4aba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6ae5a58-db83-401e-a158-ebf0981e84ec", "tag": "3115b4bc-8a8e-494e-90f7-66772013aaf5"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:08:13.794944 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e9184f70-fa0b-447a-b528-d703888e4d04 req-74663b4e-dffc-46a8-9e77-73ac092d4aba service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:13.796167 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e9184f70-fa0b-447a-b528-d703888e4d04 req-74663b4e-dffc-46a8-9e77-73ac092d4aba service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:13.828538 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-e9184f70-fa0b-447a-b528-d703888e4d04 req-74663b4e-dffc-46a8-9e77-73ac092d4aba service nova] Creating event network-changed:3115b4bc-8a8e-494e-90f7-66772013aaf5 for instance e6ae5a58-db83-401e-a158-ebf0981e84ec on hv-cinder-84762 Jun 25 16:08:13.881259 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-e9184f70-fa0b-447a-b528-d703888e4d04 req-74663b4e-dffc-46a8-9e77-73ac092d4aba service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094854 Jun 25 16:08:13.882453 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 118/237] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 16:08:13.961335 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f37cc53d-3e30-4aca-84e1-690eb2ebbbac tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-197766448", "imageRef": "84c164fa-276d-4693-b7a0-24fd3024b359", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bd043e97-1059-4931-b819-353216eaa430"}], "security_groups": [{"name": "tempest-securitygroup--1613648820"}], "key_name": "tempest-keypair-474296034", "user_data": "}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:08:14.349969 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d6acf2a8-d125-4648-b06d-707d1125e1c8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:14.358689 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-d6acf2a8-d125-4648-b06d-707d1125e1c8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd" status: 200 len: 1366 microversion: 2.1 time: 0.708792 Jun 25 16:08:14.374717 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-f37cc53d-3e30-4aca-84e1-690eb2ebbbac tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] validate_networks() for [('bd043e97-1059-4931-b819-353216eaa430', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 16:08:14.381411 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 120/238] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:13 2022] GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd => generated 1366 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:15.370458 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-f37cc53d-3e30-4aca-84e1-690eb2ebbbac tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 16:08:15.371710 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-f37cc53d-3e30-4aca-84e1-690eb2ebbbac tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 16:08:15.372457 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-f37cc53d-3e30-4aca-84e1-690eb2ebbbac tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 16:08:15.373077 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-f37cc53d-3e30-4aca-84e1-690eb2ebbbac tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 16:08:15.373654 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-f37cc53d-3e30-4aca-84e1-690eb2ebbbac tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 16:08:15.377211 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-d3a18a07-51d8-4dd5-ab5b-4a57fe97c275 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:15.385836 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-d3a18a07-51d8-4dd5-ab5b-4a57fe97c275 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 0d92f23b-4b14-4619-a2c9-a90bd96b27fd] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:15.388592 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f37cc53d-3e30-4aca-84e1-690eb2ebbbac tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:15.388979 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f37cc53d-3e30-4aca-84e1-690eb2ebbbac tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:15.390267 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f37cc53d-3e30-4aca-84e1-690eb2ebbbac tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:15.391460 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f37cc53d-3e30-4aca-84e1-690eb2ebbbac tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:15.399600 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d3a18a07-51d8-4dd5-ab5b-4a57fe97c275 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:15.400061 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d3a18a07-51d8-4dd5-ab5b-4a57fe97c275 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:15.401269 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d3a18a07-51d8-4dd5-ab5b-4a57fe97c275 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:15.401838 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d3a18a07-51d8-4dd5-ab5b-4a57fe97c275 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:15.413436 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-f37cc53d-3e30-4aca-84e1-690eb2ebbbac tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Getting quotas for project 9bcee16336834b80a389799f89b5b79a. Resources: {'ram', 'cores', 'instances'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:08:15.417883 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-f37cc53d-3e30-4aca-84e1-690eb2ebbbac tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Getting quotas for user 8a3137566b004edb909d4e3c702a7f59 and project 9bcee16336834b80a389799f89b5b79a. Resources: {'ram', 'cores', 'instances'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:08:15.433525 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f37cc53d-3e30-4aca-84e1-690eb2ebbbac tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 16:08:15.437826 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f37cc53d-3e30-4aca-84e1-690eb2ebbbac tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84c164fa-276d-4693-b7a0-24fd3024b359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 16:08:15.505353 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f37cc53d-3e30-4aca-84e1-690eb2ebbbac tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.549497 Jun 25 16:08:15.506529 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 119/239] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Jun 25 16:08:13 2022] POST /compute/v2.1/servers => generated 409 bytes in 1552 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 16:08:15.526848 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-cf1debe1-8dc0-4953-b356-b54db09b6b4c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:15.527616 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-cf1debe1-8dc0-4953-b356-b54db09b6b4c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:15.611973 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-cf1debe1-8dc0-4953-b356-b54db09b6b4c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:15.622457 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-cf1debe1-8dc0-4953-b356-b54db09b6b4c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1244 microversion: 2.1 time: 0.102993 Jun 25 16:08:15.623478 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 120/240] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:15 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1244 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:15.632802 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d3a18a07-51d8-4dd5-ab5b-4a57fe97c275 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:15.636260 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:08:15.641848 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-d3a18a07-51d8-4dd5-ab5b-4a57fe97c275 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd" status: 200 len: 1366 microversion: 2.1 time: 0.269327 Jun 25 16:08:15.642717 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 121/241] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:15 2022] GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:16.642646 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-0582d68a-53c4-48eb-9b14-2467233d97cc tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:16.643202 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0582d68a-53c4-48eb-9b14-2467233d97cc tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:16.653119 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0582d68a-53c4-48eb-9b14-2467233d97cc tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:16.653119 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0582d68a-53c4-48eb-9b14-2467233d97cc tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:16.653119 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0582d68a-53c4-48eb-9b14-2467233d97cc tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:16.653926 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0582d68a-53c4-48eb-9b14-2467233d97cc tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:16.658929 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-57b2b474-8cce-4c1e-8cc4-b4191f7c999f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:16.659612 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-57b2b474-8cce-4c1e-8cc4-b4191f7c999f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 0d92f23b-4b14-4619-a2c9-a90bd96b27fd] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:16.667511 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-57b2b474-8cce-4c1e-8cc4-b4191f7c999f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:16.668021 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-57b2b474-8cce-4c1e-8cc4-b4191f7c999f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:16.668822 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-57b2b474-8cce-4c1e-8cc4-b4191f7c999f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:16.669256 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-57b2b474-8cce-4c1e-8cc4-b4191f7c999f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:16.807935 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-0582d68a-53c4-48eb-9b14-2467233d97cc tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:16.819067 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-0582d68a-53c4-48eb-9b14-2467233d97cc tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1296 microversion: 2.1 time: 0.182056 Jun 25 16:08:16.820156 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 121/242] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:16 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1296 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:17.037680 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-57b2b474-8cce-4c1e-8cc4-b4191f7c999f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:17.047097 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-57b2b474-8cce-4c1e-8cc4-b4191f7c999f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd" status: 200 len: 1366 microversion: 2.1 time: 0.391792 Jun 25 16:08:17.047758 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 122/243] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:16 2022] GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd => generated 1366 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:17.845134 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c938dd23-9961-41f1-b504-a0a93532bd84 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:17.845769 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c938dd23-9961-41f1-b504-a0a93532bd84 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:17.852549 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c938dd23-9961-41f1-b504-a0a93532bd84 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:17.852993 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c938dd23-9961-41f1-b504-a0a93532bd84 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:17.853753 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c938dd23-9961-41f1-b504-a0a93532bd84 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:17.854180 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c938dd23-9961-41f1-b504-a0a93532bd84 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:18.063137 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c938dd23-9961-41f1-b504-a0a93532bd84 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:18.065250 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-6c4b28fd-3c0f-489d-bf2d-6172cdc5ece4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:18.065956 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-6c4b28fd-3c0f-489d-bf2d-6172cdc5ece4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 0d92f23b-4b14-4619-a2c9-a90bd96b27fd] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:18.068193 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell0:SELECT=18 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:08:18.070979 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c938dd23-9961-41f1-b504-a0a93532bd84 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1370 microversion: 2.1 time: 0.230418 Jun 25 16:08:18.071676 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 122/244] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:17 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1370 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:18.074198 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6c4b28fd-3c0f-489d-bf2d-6172cdc5ece4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:18.074842 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6c4b28fd-3c0f-489d-bf2d-6172cdc5ece4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:18.075629 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6c4b28fd-3c0f-489d-bf2d-6172cdc5ece4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:18.076071 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6c4b28fd-3c0f-489d-bf2d-6172cdc5ece4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:18.220367 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-6c4b28fd-3c0f-489d-bf2d-6172cdc5ece4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:18.228398 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-6c4b28fd-3c0f-489d-bf2d-6172cdc5ece4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd" status: 200 len: 1366 microversion: 2.1 time: 0.167138 Jun 25 16:08:18.234355 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 123/245] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:18 2022] GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:08:19.093220 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-63cadb84-55d6-4692-8890-bea779d263e6 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:19.094385 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-63cadb84-55d6-4692-8890-bea779d263e6 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:19.103357 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-63cadb84-55d6-4692-8890-bea779d263e6 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:19.103806 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-63cadb84-55d6-4692-8890-bea779d263e6 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:19.104590 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-63cadb84-55d6-4692-8890-bea779d263e6 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:19.105026 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-63cadb84-55d6-4692-8890-bea779d263e6 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:19.242593 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-63cadb84-55d6-4692-8890-bea779d263e6 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:19.245371 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-0fe92e78-bee1-443a-9a29-6f3648403fcf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:19.246449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-0fe92e78-bee1-443a-9a29-6f3648403fcf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 0d92f23b-4b14-4619-a2c9-a90bd96b27fd] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:19.250870 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-63cadb84-55d6-4692-8890-bea779d263e6 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1370 microversion: 2.1 time: 0.164226 Jun 25 16:08:19.251923 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 123/246] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:19 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1370 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:19.253224 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0fe92e78-bee1-443a-9a29-6f3648403fcf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:19.253657 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0fe92e78-bee1-443a-9a29-6f3648403fcf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:19.255112 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0fe92e78-bee1-443a-9a29-6f3648403fcf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:19.255621 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0fe92e78-bee1-443a-9a29-6f3648403fcf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:19.385828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-0fe92e78-bee1-443a-9a29-6f3648403fcf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:19.393744 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-0fe92e78-bee1-443a-9a29-6f3648403fcf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd" status: 200 len: 1366 microversion: 2.1 time: 0.152122 Jun 25 16:08:19.394282 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 124/247] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:19 2022] GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:08:20.268681 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2c642b4a-8483-42da-a157-2c9466226c3f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:20.268681 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2c642b4a-8483-42da-a157-2c9466226c3f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:20.275846 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2c642b4a-8483-42da-a157-2c9466226c3f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:20.276316 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2c642b4a-8483-42da-a157-2c9466226c3f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:20.277113 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2c642b4a-8483-42da-a157-2c9466226c3f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:20.277563 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2c642b4a-8483-42da-a157-2c9466226c3f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:20.411182 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-a03541d9-8729-4710-a293-30e5c94d7983 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:20.411947 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-a03541d9-8729-4710-a293-30e5c94d7983 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 0d92f23b-4b14-4619-a2c9-a90bd96b27fd] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:20.418979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a03541d9-8729-4710-a293-30e5c94d7983 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:20.419512 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a03541d9-8729-4710-a293-30e5c94d7983 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:20.420351 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a03541d9-8729-4710-a293-30e5c94d7983 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:20.420900 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a03541d9-8729-4710-a293-30e5c94d7983 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:20.515519 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2c642b4a-8483-42da-a157-2c9466226c3f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:20.523595 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2c642b4a-8483-42da-a157-2c9466226c3f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1370 microversion: 2.1 time: 0.259753 Jun 25 16:08:20.524093 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 124/248] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:20 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1370 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:20.629921 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-a03541d9-8729-4710-a293-30e5c94d7983 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:20.637870 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-a03541d9-8729-4710-a293-30e5c94d7983 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd" status: 200 len: 1366 microversion: 2.1 time: 0.230546 Jun 25 16:08:20.638440 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 125/249] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:20 2022] GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:20.902383 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-38736f28-08ee-4d78-a6c0-52d4b849e420 req-473a09fe-ca58-41c1-b999-ba2922ab55a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8de27285-8f18-4d98-b240-0042e68f7ff9", "tag": "17f4711f-55ed-463b-986b-2d3077795600"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:08:20.910301 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-38736f28-08ee-4d78-a6c0-52d4b849e420 req-473a09fe-ca58-41c1-b999-ba2922ab55a3 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:20.910732 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-38736f28-08ee-4d78-a6c0-52d4b849e420 req-473a09fe-ca58-41c1-b999-ba2922ab55a3 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:20.922477 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-38736f28-08ee-4d78-a6c0-52d4b849e420 req-473a09fe-ca58-41c1-b999-ba2922ab55a3 service nova] Creating event network-changed:17f4711f-55ed-463b-986b-2d3077795600 for instance 8de27285-8f18-4d98-b240-0042e68f7ff9 on hv-cinder-84762 Jun 25 16:08:20.934394 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-38736f28-08ee-4d78-a6c0-52d4b849e420 req-473a09fe-ca58-41c1-b999-ba2922ab55a3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035496 Jun 25 16:08:20.935188 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 125/250] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:08:21.539967 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-86d514ff-1b33-4866-86ce-26bb751272b6 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:21.541270 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-86d514ff-1b33-4866-86ce-26bb751272b6 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:21.550245 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-86d514ff-1b33-4866-86ce-26bb751272b6 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:21.550971 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-86d514ff-1b33-4866-86ce-26bb751272b6 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:21.551789 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-86d514ff-1b33-4866-86ce-26bb751272b6 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:21.552291 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-86d514ff-1b33-4866-86ce-26bb751272b6 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:21.656372 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-41048d23-ea8a-467b-b846-bbb502714fd7 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:21.657090 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-41048d23-ea8a-467b-b846-bbb502714fd7 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 0d92f23b-4b14-4619-a2c9-a90bd96b27fd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:21.666095 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-41048d23-ea8a-467b-b846-bbb502714fd7 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:21.666569 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-41048d23-ea8a-467b-b846-bbb502714fd7 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:21.667342 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-41048d23-ea8a-467b-b846-bbb502714fd7 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:21.667784 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-41048d23-ea8a-467b-b846-bbb502714fd7 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:21.797520 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-86d514ff-1b33-4866-86ce-26bb751272b6 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:21.805778 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-86d514ff-1b33-4866-86ce-26bb751272b6 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1370 microversion: 2.1 time: 0.269695 Jun 25 16:08:21.806463 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 126/251] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:21 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1370 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:21.944036 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-41048d23-ea8a-467b-b846-bbb502714fd7 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:21.954823 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-41048d23-ea8a-467b-b846-bbb502714fd7 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd" status: 200 len: 1366 microversion: 2.1 time: 0.302494 Jun 25 16:08:21.955548 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 126/252] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:21 2022] GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd => generated 1366 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:08:22.827193 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-4ecfd0db-ec03-4cc9-bbf3-a9ee3740dfa4 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:22.828229 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-4ecfd0db-ec03-4cc9-bbf3-a9ee3740dfa4 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:22.837504 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4ecfd0db-ec03-4cc9-bbf3-a9ee3740dfa4 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:22.837928 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4ecfd0db-ec03-4cc9-bbf3-a9ee3740dfa4 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:22.838727 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4ecfd0db-ec03-4cc9-bbf3-a9ee3740dfa4 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:22.839159 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4ecfd0db-ec03-4cc9-bbf3-a9ee3740dfa4 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:22.971468 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-35d4f22f-5f28-4474-adaa-eb0623946296 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:22.972037 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-35d4f22f-5f28-4474-adaa-eb0623946296 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 0d92f23b-4b14-4619-a2c9-a90bd96b27fd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:22.978750 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-4ecfd0db-ec03-4cc9-bbf3-a9ee3740dfa4 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:22.979623 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-35d4f22f-5f28-4474-adaa-eb0623946296 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:22.980081 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-35d4f22f-5f28-4474-adaa-eb0623946296 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:22.980881 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-35d4f22f-5f28-4474-adaa-eb0623946296 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:22.981317 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-35d4f22f-5f28-4474-adaa-eb0623946296 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:22.986888 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-4ecfd0db-ec03-4cc9-bbf3-a9ee3740dfa4 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1370 microversion: 2.1 time: 0.166219 Jun 25 16:08:22.987641 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 127/253] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:22 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1370 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:23.112779 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-35d4f22f-5f28-4474-adaa-eb0623946296 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:23.120538 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-35d4f22f-5f28-4474-adaa-eb0623946296 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd" status: 200 len: 1366 microversion: 2.1 time: 0.153094 Jun 25 16:08:23.121098 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 127/254] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:22 2022] GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:24.003544 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-6cb39644-3599-464d-9e5e-a33608871e8a tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:24.003973 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-6cb39644-3599-464d-9e5e-a33608871e8a tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:24.012949 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6cb39644-3599-464d-9e5e-a33608871e8a tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:24.013579 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6cb39644-3599-464d-9e5e-a33608871e8a tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:24.014740 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6cb39644-3599-464d-9e5e-a33608871e8a tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:24.015600 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6cb39644-3599-464d-9e5e-a33608871e8a tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:24.140644 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ffaeca3f-7ddd-4dbb-b300-05e8c42b5f6b tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:24.141229 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ffaeca3f-7ddd-4dbb-b300-05e8c42b5f6b tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 0d92f23b-4b14-4619-a2c9-a90bd96b27fd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:24.148853 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ffaeca3f-7ddd-4dbb-b300-05e8c42b5f6b tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:24.149308 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ffaeca3f-7ddd-4dbb-b300-05e8c42b5f6b tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:24.150214 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ffaeca3f-7ddd-4dbb-b300-05e8c42b5f6b tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:24.150653 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ffaeca3f-7ddd-4dbb-b300-05e8c42b5f6b tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:24.168107 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-6cb39644-3599-464d-9e5e-a33608871e8a tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:24.175687 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-6cb39644-3599-464d-9e5e-a33608871e8a tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1370 microversion: 2.1 time: 0.176318 Jun 25 16:08:24.176352 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 128/255] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:23 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:24.288615 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ffaeca3f-7ddd-4dbb-b300-05e8c42b5f6b tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:24.297323 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ffaeca3f-7ddd-4dbb-b300-05e8c42b5f6b tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd" status: 200 len: 1366 microversion: 2.1 time: 0.162097 Jun 25 16:08:24.298243 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 128/256] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:24 2022] GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:25.193037 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-74bb1998-bc67-4356-b627-3008f385ddcd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:25.193829 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-74bb1998-bc67-4356-b627-3008f385ddcd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:25.200086 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-74bb1998-bc67-4356-b627-3008f385ddcd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:25.200576 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-74bb1998-bc67-4356-b627-3008f385ddcd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:25.201356 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-74bb1998-bc67-4356-b627-3008f385ddcd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:25.201798 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-74bb1998-bc67-4356-b627-3008f385ddcd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:25.314952 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b1607ae1-eba2-41e7-8a44-0233f1814a85 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:25.315561 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b1607ae1-eba2-41e7-8a44-0233f1814a85 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 0d92f23b-4b14-4619-a2c9-a90bd96b27fd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:25.322721 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b1607ae1-eba2-41e7-8a44-0233f1814a85 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:25.323174 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b1607ae1-eba2-41e7-8a44-0233f1814a85 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:25.323935 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b1607ae1-eba2-41e7-8a44-0233f1814a85 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:25.324376 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b1607ae1-eba2-41e7-8a44-0233f1814a85 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:25.339366 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-74bb1998-bc67-4356-b627-3008f385ddcd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:25.347154 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-74bb1998-bc67-4356-b627-3008f385ddcd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1370 microversion: 2.1 time: 0.158536 Jun 25 16:08:25.347786 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 129/257] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:25 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:25.399954 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=4 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:08:25.459138 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b1607ae1-eba2-41e7-8a44-0233f1814a85 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:25.466871 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b1607ae1-eba2-41e7-8a44-0233f1814a85 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd" status: 200 len: 1366 microversion: 2.1 time: 0.155846 Jun 25 16:08:25.467401 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 129/258] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:25 2022] GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:25.855023 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-0a2bcc7d-0301-4eaf-b042-a3d5afd1405a req-c63d108c-2772-4f05-8fcb-d86abee4fd69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d92f23b-4b14-4619-a2c9-a90bd96b27fd", "name": "network-vif-plugged", "status": "completed", "tag": "dc0159e7-f976-4ca8-a996-a731692f1e35"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:08:25.864797 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-0a2bcc7d-0301-4eaf-b042-a3d5afd1405a req-c63d108c-2772-4f05-8fcb-d86abee4fd69 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:25.865473 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-0a2bcc7d-0301-4eaf-b042-a3d5afd1405a req-c63d108c-2772-4f05-8fcb-d86abee4fd69 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:25.878089 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-0a2bcc7d-0301-4eaf-b042-a3d5afd1405a req-c63d108c-2772-4f05-8fcb-d86abee4fd69 service nova] Creating event network-vif-plugged:dc0159e7-f976-4ca8-a996-a731692f1e35 for instance 0d92f23b-4b14-4619-a2c9-a90bd96b27fd on hv-cinder-84762 Jun 25 16:08:25.883383 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-0a2bcc7d-0301-4eaf-b042-a3d5afd1405a req-c63d108c-2772-4f05-8fcb-d86abee4fd69 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032106 Jun 25 16:08:25.883976 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 130/259] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:08:26.365227 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-098529a7-6dfc-4fe6-8d84-61306528106b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:26.365756 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-098529a7-6dfc-4fe6-8d84-61306528106b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:26.367589 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=18 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:08:26.373925 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-098529a7-6dfc-4fe6-8d84-61306528106b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:26.374399 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-098529a7-6dfc-4fe6-8d84-61306528106b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:26.375168 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-098529a7-6dfc-4fe6-8d84-61306528106b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:26.375602 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-098529a7-6dfc-4fe6-8d84-61306528106b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:26.486445 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-f2e31149-c7f2-4478-ae9d-3f9abae89641 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:26.487892 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-f2e31149-c7f2-4478-ae9d-3f9abae89641 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 0d92f23b-4b14-4619-a2c9-a90bd96b27fd] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:26.495610 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f2e31149-c7f2-4478-ae9d-3f9abae89641 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:26.496315 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f2e31149-c7f2-4478-ae9d-3f9abae89641 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:26.497211 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f2e31149-c7f2-4478-ae9d-3f9abae89641 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:26.497719 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f2e31149-c7f2-4478-ae9d-3f9abae89641 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:26.523754 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-098529a7-6dfc-4fe6-8d84-61306528106b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:26.532835 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-098529a7-6dfc-4fe6-8d84-61306528106b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1370 microversion: 2.1 time: 0.171799 Jun 25 16:08:26.533950 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 130/260] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:26 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:26.648375 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-f2e31149-c7f2-4478-ae9d-3f9abae89641 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:26.661888 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-f2e31149-c7f2-4478-ae9d-3f9abae89641 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd" status: 200 len: 1366 microversion: 2.1 time: 0.178975 Jun 25 16:08:26.667542 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 131/261] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:26 2022] GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:08:27.340187 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d37f6bf6-d36d-4e87-b996-f37783a76304 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-638247170", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1809084523", "security_groups": [{"name": "tempest-secgroup-smoke-1937898623"}], "networks": [{"uuid": "f890c253-6159-4bda-8d76-0d3eba6fa404"}], "block_device_mapping_v2": [{"uuid": "3fef9a64-cf30-44cd-8330-52b7e4151462", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:08:27.478391 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-d37f6bf6-d36d-4e87-b996-f37783a76304 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] validate_networks() for [('f890c253-6159-4bda-8d76-0d3eba6fa404', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 16:08:27.552219 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-28c15bf9-f456-413b-be40-231be6b76d2d tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:27.553515 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-28c15bf9-f456-413b-be40-231be6b76d2d tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:27.560745 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-28c15bf9-f456-413b-be40-231be6b76d2d tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:27.561588 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-28c15bf9-f456-413b-be40-231be6b76d2d tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:27.562561 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-28c15bf9-f456-413b-be40-231be6b76d2d tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:27.563191 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-28c15bf9-f456-413b-be40-231be6b76d2d tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:27.865942 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-28c15bf9-f456-413b-be40-231be6b76d2d tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:27.877329 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-28c15bf9-f456-413b-be40-231be6b76d2d tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1370 microversion: 2.1 time: 0.330022 Jun 25 16:08:27.878039 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 132/262] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:27 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1370 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:08:27.895303 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-951f3af8-9f8f-48f0-9515-63df30a6f74d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:27.896929 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-951f3af8-9f8f-48f0-9515-63df30a6f74d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 0d92f23b-4b14-4619-a2c9-a90bd96b27fd] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:27.904900 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-951f3af8-9f8f-48f0-9515-63df30a6f74d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:27.905601 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-951f3af8-9f8f-48f0-9515-63df30a6f74d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:27.907022 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-951f3af8-9f8f-48f0-9515-63df30a6f74d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:27.907638 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-951f3af8-9f8f-48f0-9515-63df30a6f74d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:28.110689 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-d37f6bf6-d36d-4e87-b996-f37783a76304 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 16:08:28.111512 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-d37f6bf6-d36d-4e87-b996-f37783a76304 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 16:08:28.112175 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-d37f6bf6-d36d-4e87-b996-f37783a76304 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 16:08:28.112872 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-d37f6bf6-d36d-4e87-b996-f37783a76304 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 16:08:28.113791 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-d37f6bf6-d36d-4e87-b996-f37783a76304 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 16:08:28.124616 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d37f6bf6-d36d-4e87-b996-f37783a76304 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:28.125026 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d37f6bf6-d36d-4e87-b996-f37783a76304 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:28.126083 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d37f6bf6-d36d-4e87-b996-f37783a76304 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:28.126708 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d37f6bf6-d36d-4e87-b996-f37783a76304 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:28.130922 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-951f3af8-9f8f-48f0-9515-63df30a6f74d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:28.143780 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-951f3af8-9f8f-48f0-9515-63df30a6f74d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd" status: 200 len: 1366 microversion: 2.1 time: 0.253595 Jun 25 16:08:28.144934 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 133/263] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:27 2022] GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:28.167922 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-d37f6bf6-d36d-4e87-b996-f37783a76304 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Getting quotas for project 9b1a552fc6cc43bb80f8a5f951bfcf80. Resources: {'ram', 'cores', 'instances'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:08:28.174489 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-d37f6bf6-d36d-4e87-b996-f37783a76304 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Getting quotas for user 5bd682806c864805a3b410411839ca99 and project 9b1a552fc6cc43bb80f8a5f951bfcf80. Resources: {'ram', 'cores', 'instances'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:08:28.250963 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d37f6bf6-d36d-4e87-b996-f37783a76304 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 16:08:28.253166 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d37f6bf6-d36d-4e87-b996-f37783a76304 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3fef9a64-cf30-44cd-8330-52b7e4151462',volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 16:08:28.405432 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d37f6bf6-d36d-4e87-b996-f37783a76304 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.069400 Jun 25 16:08:28.406086 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 131/264] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Jun 25 16:08:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 1071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 16:08:28.416202 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-5211b962-4327-45b6-a16e-7c9828acb656 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:28.416803 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-5211b962-4327-45b6-a16e-7c9828acb656 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:28.496881 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-5211b962-4327-45b6-a16e-7c9828acb656 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:28.508166 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-5211b962-4327-45b6-a16e-7c9828acb656 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1088 microversion: 2.1 time: 0.095665 Jun 25 16:08:28.508788 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 134/265] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:28 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1088 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:28.900981 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7295c8fd-09df-4acc-a7c6-f3399eee5dc7 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:28.901835 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7295c8fd-09df-4acc-a7c6-f3399eee5dc7 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:28.915157 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7295c8fd-09df-4acc-a7c6-f3399eee5dc7 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:28.915924 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7295c8fd-09df-4acc-a7c6-f3399eee5dc7 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:28.917148 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7295c8fd-09df-4acc-a7c6-f3399eee5dc7 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:28.918929 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7295c8fd-09df-4acc-a7c6-f3399eee5dc7 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:29.157300 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7295c8fd-09df-4acc-a7c6-f3399eee5dc7 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:29.162291 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-f5d2fb85-5ca3-4c77-bfc6-976c3a61b9eb tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:29.162908 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-f5d2fb85-5ca3-4c77-bfc6-976c3a61b9eb tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 0d92f23b-4b14-4619-a2c9-a90bd96b27fd] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:29.165723 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7295c8fd-09df-4acc-a7c6-f3399eee5dc7 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1370 microversion: 2.1 time: 0.273342 Jun 25 16:08:29.172510 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 132/266] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:28 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1370 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:29.172697 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f5d2fb85-5ca3-4c77-bfc6-976c3a61b9eb tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:29.172697 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f5d2fb85-5ca3-4c77-bfc6-976c3a61b9eb tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:29.172697 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f5d2fb85-5ca3-4c77-bfc6-976c3a61b9eb tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:29.172697 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f5d2fb85-5ca3-4c77-bfc6-976c3a61b9eb tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:29.314242 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-f5d2fb85-5ca3-4c77-bfc6-976c3a61b9eb tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:29.322820 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-f5d2fb85-5ca3-4c77-bfc6-976c3a61b9eb tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd" status: 200 len: 1557 microversion: 2.1 time: 0.165174 Jun 25 16:08:29.323707 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 135/267] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:29 2022] GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd => generated 1557 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:29.340340 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a79cd093-6566-4d4d-9a44-8b83a95b0e28 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:29.340867 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a79cd093-6566-4d4d-9a44-8b83a95b0e28 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 0d92f23b-4b14-4619-a2c9-a90bd96b27fd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:29.346807 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a79cd093-6566-4d4d-9a44-8b83a95b0e28 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:29.347252 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a79cd093-6566-4d4d-9a44-8b83a95b0e28 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:29.348002 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a79cd093-6566-4d4d-9a44-8b83a95b0e28 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:29.348669 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a79cd093-6566-4d4d-9a44-8b83a95b0e28 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:29.428017 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a79cd093-6566-4d4d-9a44-8b83a95b0e28 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091592 Jun 25 16:08:29.428859 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 133/268] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Jun 25 16:08:29 2022] GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 16:08:29.527370 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-14d44e47-fb3a-45f8-a3b9-ae689b2ff5a6 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:29.528441 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-14d44e47-fb3a-45f8-a3b9-ae689b2ff5a6 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:29.536670 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-14d44e47-fb3a-45f8-a3b9-ae689b2ff5a6 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:29.537207 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-14d44e47-fb3a-45f8-a3b9-ae689b2ff5a6 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:29.538169 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-14d44e47-fb3a-45f8-a3b9-ae689b2ff5a6 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:29.538595 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-14d44e47-fb3a-45f8-a3b9-ae689b2ff5a6 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:29.604088 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-14d44e47-fb3a-45f8-a3b9-ae689b2ff5a6 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:29.615801 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-14d44e47-fb3a-45f8-a3b9-ae689b2ff5a6 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1186 microversion: 2.1 time: 0.093442 Jun 25 16:08:29.616388 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 136/269] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:29 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1186 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:30.183960 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9d4b2a2b-1e07-44e9-8c4f-701823d94f45 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:30.184612 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9d4b2a2b-1e07-44e9-8c4f-701823d94f45 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:30.191777 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9d4b2a2b-1e07-44e9-8c4f-701823d94f45 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:30.192690 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9d4b2a2b-1e07-44e9-8c4f-701823d94f45 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:30.193532 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9d4b2a2b-1e07-44e9-8c4f-701823d94f45 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:30.194033 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9d4b2a2b-1e07-44e9-8c4f-701823d94f45 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:30.435278 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9d4b2a2b-1e07-44e9-8c4f-701823d94f45 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:30.443932 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9d4b2a2b-1e07-44e9-8c4f-701823d94f45 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1370 microversion: 2.1 time: 0.264338 Jun 25 16:08:30.444995 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 134/270] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:30 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1370 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:30.636053 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-6aeee5b0-98d6-4751-b1bb-00e94121eeeb tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:30.637580 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-6aeee5b0-98d6-4751-b1bb-00e94121eeeb tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:30.657443 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-ffd345b2-f216-4763-80e7-d1b75fbcff3d req-fdeabfa4-eda3-42d2-b99e-bd19d54e8a1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d92f23b-4b14-4619-a2c9-a90bd96b27fd", "tag": "dc0159e7-f976-4ca8-a996-a731692f1e35"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:08:30.666102 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-ffd345b2-f216-4763-80e7-d1b75fbcff3d req-fdeabfa4-eda3-42d2-b99e-bd19d54e8a1f service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:30.666792 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-ffd345b2-f216-4763-80e7-d1b75fbcff3d req-fdeabfa4-eda3-42d2-b99e-bd19d54e8a1f service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:30.685719 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-ffd345b2-f216-4763-80e7-d1b75fbcff3d req-fdeabfa4-eda3-42d2-b99e-bd19d54e8a1f service nova] Creating event network-changed:dc0159e7-f976-4ca8-a996-a731692f1e35 for instance 0d92f23b-4b14-4619-a2c9-a90bd96b27fd on hv-cinder-84762 Jun 25 16:08:30.689623 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6aeee5b0-98d6-4751-b1bb-00e94121eeeb tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:30.690201 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6aeee5b0-98d6-4751-b1bb-00e94121eeeb tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:30.691045 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6aeee5b0-98d6-4751-b1bb-00e94121eeeb tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:30.695642 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-ffd345b2-f216-4763-80e7-d1b75fbcff3d req-fdeabfa4-eda3-42d2-b99e-bd19d54e8a1f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040268 Jun 25 16:08:30.695925 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6aeee5b0-98d6-4751-b1bb-00e94121eeeb tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:30.698167 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 135/271] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 16:08:30.785065 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-6aeee5b0-98d6-4751-b1bb-00e94121eeeb tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:30.792709 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-6aeee5b0-98d6-4751-b1bb-00e94121eeeb tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1186 microversion: 2.1 time: 0.163067 Jun 25 16:08:30.793276 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 137/272] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:30 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1186 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:31.463493 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ed1685b4-22a7-4511-9e09-e3b08bdbdc50 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:31.464291 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ed1685b4-22a7-4511-9e09-e3b08bdbdc50 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:31.473820 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ed1685b4-22a7-4511-9e09-e3b08bdbdc50 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:31.474864 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ed1685b4-22a7-4511-9e09-e3b08bdbdc50 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:31.475480 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ed1685b4-22a7-4511-9e09-e3b08bdbdc50 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:31.476111 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ed1685b4-22a7-4511-9e09-e3b08bdbdc50 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:31.617259 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ed1685b4-22a7-4511-9e09-e3b08bdbdc50 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:31.625554 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ed1685b4-22a7-4511-9e09-e3b08bdbdc50 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1370 microversion: 2.1 time: 0.167774 Jun 25 16:08:31.626209 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 136/273] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:31 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:31.731264 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-e4d52c30-6222-4293-bdd6-90042412c9c9 req-b014c519-3f6f-456d-983a-72208a85a977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8de27285-8f18-4d98-b240-0042e68f7ff9", "name": "network-vif-plugged", "status": "completed", "tag": "17f4711f-55ed-463b-986b-2d3077795600"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:08:31.740389 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-e4d52c30-6222-4293-bdd6-90042412c9c9 req-b014c519-3f6f-456d-983a-72208a85a977 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:31.740843 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-e4d52c30-6222-4293-bdd6-90042412c9c9 req-b014c519-3f6f-456d-983a-72208a85a977 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:31.753223 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-e4d52c30-6222-4293-bdd6-90042412c9c9 req-b014c519-3f6f-456d-983a-72208a85a977 service nova] Creating event network-vif-plugged:17f4711f-55ed-463b-986b-2d3077795600 for instance 8de27285-8f18-4d98-b240-0042e68f7ff9 on hv-cinder-84762 Jun 25 16:08:31.758836 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-e4d52c30-6222-4293-bdd6-90042412c9c9 req-b014c519-3f6f-456d-983a-72208a85a977 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031337 Jun 25 16:08:31.759599 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 138/274] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 16:08:31.810497 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ccbff948-9dce-4dd6-a40d-5c6958de5496 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:31.811108 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ccbff948-9dce-4dd6-a40d-5c6958de5496 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:31.817922 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ccbff948-9dce-4dd6-a40d-5c6958de5496 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:31.818435 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ccbff948-9dce-4dd6-a40d-5c6958de5496 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:31.819232 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ccbff948-9dce-4dd6-a40d-5c6958de5496 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:31.819669 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ccbff948-9dce-4dd6-a40d-5c6958de5496 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:31.885659 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ccbff948-9dce-4dd6-a40d-5c6958de5496 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:31.893901 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ccbff948-9dce-4dd6-a40d-5c6958de5496 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1186 microversion: 2.1 time: 0.087290 Jun 25 16:08:31.894487 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 137/275] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:31 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1186 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:32.616429 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-84e353ba-fdc5-4b56-9ad2-c2cbef4a3092 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1485860823", "imageRef": "84c164fa-276d-4693-b7a0-24fd3024b359", "flavorRef": "452", "networks": [{"uuid": "31bcb26d-3ca1-4959-a614-488af5d3fcfe"}]}} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:08:32.643413 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-833dd648-ea36-4478-bdde-55221967bcbd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:32.644021 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-833dd648-ea36-4478-bdde-55221967bcbd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:32.650685 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-833dd648-ea36-4478-bdde-55221967bcbd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:32.651134 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-833dd648-ea36-4478-bdde-55221967bcbd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:32.651892 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-833dd648-ea36-4478-bdde-55221967bcbd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:32.652325 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-833dd648-ea36-4478-bdde-55221967bcbd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:32.673692 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.network.neutron [None req-84e353ba-fdc5-4b56-9ad2-c2cbef4a3092 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] validate_networks() for [('31bcb26d-3ca1-4959-a614-488af5d3fcfe', None, None, None, None, None)] {{(pid=117794) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 16:08:33.041576 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-833dd648-ea36-4478-bdde-55221967bcbd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:33.046638 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=100 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:08:33.053515 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-833dd648-ea36-4478-bdde-55221967bcbd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1370 microversion: 2.1 time: 0.414519 Jun 25 16:08:33.063907 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 138/276] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:32 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1370 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:33.068842 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b2c4ff90-87b3-4cd6-a821-15fe62cd4fba tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:33.069431 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b2c4ff90-87b3-4cd6-a821-15fe62cd4fba tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:33.071298 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:08:33.077964 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b2c4ff90-87b3-4cd6-a821-15fe62cd4fba tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:33.082530 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b2c4ff90-87b3-4cd6-a821-15fe62cd4fba tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:33.083469 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b2c4ff90-87b3-4cd6-a821-15fe62cd4fba tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:33.084298 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b2c4ff90-87b3-4cd6-a821-15fe62cd4fba tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:33.189901 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b2c4ff90-87b3-4cd6-a821-15fe62cd4fba tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:33.198391 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b2c4ff90-87b3-4cd6-a821-15fe62cd4fba tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1204 microversion: 2.1 time: 0.133162 Jun 25 16:08:33.199290 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 139/277] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:33 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1204 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:33.447996 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-84e353ba-fdc5-4b56-9ad2-c2cbef4a3092 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Flavor limits 0:0:0 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 16:08:33.448517 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-84e353ba-fdc5-4b56-9ad2-c2cbef4a3092 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Image limits 0:0:0 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 16:08:33.449055 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-84e353ba-fdc5-4b56-9ad2-c2cbef4a3092 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Flavor pref 0:0:0 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 16:08:33.450176 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-84e353ba-fdc5-4b56-9ad2-c2cbef4a3092 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Image pref 0:0:0 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 16:08:33.450586 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-84e353ba-fdc5-4b56-9ad2-c2cbef4a3092 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 16:08:33.463519 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-84e353ba-fdc5-4b56-9ad2-c2cbef4a3092 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:33.464209 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-84e353ba-fdc5-4b56-9ad2-c2cbef4a3092 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:33.465202 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-84e353ba-fdc5-4b56-9ad2-c2cbef4a3092 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:33.465753 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-84e353ba-fdc5-4b56-9ad2-c2cbef4a3092 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:33.511692 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.quota [None req-84e353ba-fdc5-4b56-9ad2-c2cbef4a3092 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Getting quotas for project be35accfa19641058c6452311878f2d4. Resources: {'ram', 'cores', 'instances'} {{(pid=117794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:08:33.517070 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.quota [None req-84e353ba-fdc5-4b56-9ad2-c2cbef4a3092 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Getting quotas for user bbf2525354424683bfa550eadc0a748c and project be35accfa19641058c6452311878f2d4. Resources: {'ram', 'cores', 'instances'} {{(pid=117794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:08:33.538714 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-84e353ba-fdc5-4b56-9ad2-c2cbef4a3092 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Going to run 1 instances... {{(pid=117794) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 16:08:33.542183 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-84e353ba-fdc5-4b56-9ad2-c2cbef4a3092 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 24aa2353-f0e0-4f23-bc4c-e3567861148c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84c164fa-276d-4693-b7a0-24fd3024b359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 16:08:33.598559 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-84e353ba-fdc5-4b56-9ad2-c2cbef4a3092 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.986819 Jun 25 16:08:33.599577 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 139/278] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Jun 25 16:08:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 989 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 16:08:33.610398 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8e3f8c47-a670-41ca-8a84-f7730018a4ca tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:33.611372 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8e3f8c47-a670-41ca-8a84-f7730018a4ca tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 24aa2353-f0e0-4f23-bc4c-e3567861148c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:33.714654 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8e3f8c47-a670-41ca-8a84-f7730018a4ca tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:33.723315 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8e3f8c47-a670-41ca-8a84-f7730018a4ca tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c" status: 200 len: 1214 microversion: 2.1 time: 0.117406 Jun 25 16:08:33.724006 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 140/279] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:33 2022] GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c => generated 1214 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:34.071284 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-93e7d211-0008-4353-8780-cfcdcd5e03ab tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:34.071854 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-93e7d211-0008-4353-8780-cfcdcd5e03ab tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:34.080108 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-93e7d211-0008-4353-8780-cfcdcd5e03ab tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:34.080672 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-93e7d211-0008-4353-8780-cfcdcd5e03ab tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:34.081551 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-93e7d211-0008-4353-8780-cfcdcd5e03ab tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:34.082173 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-93e7d211-0008-4353-8780-cfcdcd5e03ab tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:34.220703 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-fd8e3e5f-6ebd-43d3-a74c-79651957a987 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:34.221429 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-fd8e3e5f-6ebd-43d3-a74c-79651957a987 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:34.224226 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-93e7d211-0008-4353-8780-cfcdcd5e03ab tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:34.228520 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fd8e3e5f-6ebd-43d3-a74c-79651957a987 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:34.228968 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fd8e3e5f-6ebd-43d3-a74c-79651957a987 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:34.229734 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fd8e3e5f-6ebd-43d3-a74c-79651957a987 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:34.230168 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fd8e3e5f-6ebd-43d3-a74c-79651957a987 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:34.232429 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-93e7d211-0008-4353-8780-cfcdcd5e03ab tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1563 microversion: 2.1 time: 0.165331 Jun 25 16:08:34.233017 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 140/280] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:34 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1563 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:34.249155 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-41a9d9a6-c467-4704-a673-d1c57d3aa4e7 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:34.249649 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-41a9d9a6-c467-4704-a673-d1c57d3aa4e7 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:34.255996 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-41a9d9a6-c467-4704-a673-d1c57d3aa4e7 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:34.256473 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-41a9d9a6-c467-4704-a673-d1c57d3aa4e7 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:34.257254 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-41a9d9a6-c467-4704-a673-d1c57d3aa4e7 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:34.257695 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-41a9d9a6-c467-4704-a673-d1c57d3aa4e7 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:34.275672 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=100 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:08:34.364618 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-41a9d9a6-c467-4704-a673-d1c57d3aa4e7 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.119182 Jun 25 16:08:34.365265 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 141/281] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Jun 25 16:08:34 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:08:34.469111 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fd8e3e5f-6ebd-43d3-a74c-79651957a987 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:34.477359 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-fd8e3e5f-6ebd-43d3-a74c-79651957a987 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1260 microversion: 2.1 time: 0.262638 Jun 25 16:08:34.478076 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 141/282] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:34 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1260 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:34.743776 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-143ddeb7-e081-4cb9-ba0c-59bcd8571cc6 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:34.744550 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-143ddeb7-e081-4cb9-ba0c-59bcd8571cc6 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 24aa2353-f0e0-4f23-bc4c-e3567861148c] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:34.752924 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-143ddeb7-e081-4cb9-ba0c-59bcd8571cc6 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:34.753385 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-143ddeb7-e081-4cb9-ba0c-59bcd8571cc6 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:34.754921 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-143ddeb7-e081-4cb9-ba0c-59bcd8571cc6 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:34.755357 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-143ddeb7-e081-4cb9-ba0c-59bcd8571cc6 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:35.201829 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-143ddeb7-e081-4cb9-ba0c-59bcd8571cc6 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:35.210364 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-143ddeb7-e081-4cb9-ba0c-59bcd8571cc6 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c" status: 200 len: 1210 microversion: 2.1 time: 0.472213 Jun 25 16:08:35.211034 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 142/283] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:34 2022] GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c => generated 1210 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:35.495869 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-63d248e7-5ec1-4129-8771-de8b706c8a51 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:35.497284 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-63d248e7-5ec1-4129-8771-de8b706c8a51 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:35.504122 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-63d248e7-5ec1-4129-8771-de8b706c8a51 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:35.504750 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-63d248e7-5ec1-4129-8771-de8b706c8a51 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:35.505818 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-63d248e7-5ec1-4129-8771-de8b706c8a51 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:35.506796 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-63d248e7-5ec1-4129-8771-de8b706c8a51 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:35.961112 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-63d248e7-5ec1-4129-8771-de8b706c8a51 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:35.970606 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-63d248e7-5ec1-4129-8771-de8b706c8a51 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1260 microversion: 2.1 time: 0.478666 Jun 25 16:08:35.971285 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 142/284] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:35 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1260 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:36.237656 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-9b9a2ea4-6221-479a-8704-154dfc19e6a1 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:36.238373 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-9b9a2ea4-6221-479a-8704-154dfc19e6a1 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 24aa2353-f0e0-4f23-bc4c-e3567861148c] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:36.245128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9b9a2ea4-6221-479a-8704-154dfc19e6a1 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:36.245684 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9b9a2ea4-6221-479a-8704-154dfc19e6a1 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:36.246652 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9b9a2ea4-6221-479a-8704-154dfc19e6a1 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:36.247091 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9b9a2ea4-6221-479a-8704-154dfc19e6a1 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:36.348683 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-9b9a2ea4-6221-479a-8704-154dfc19e6a1 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:36.356705 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-9b9a2ea4-6221-479a-8704-154dfc19e6a1 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c" status: 200 len: 1272 microversion: 2.1 time: 0.122994 Jun 25 16:08:36.357288 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 143/285] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:36 2022] GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c => generated 1272 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:08:36.976728 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-9997613b-3066-46b7-a7ff-6329d26c4800 req-8e3d60b0-dbb6-4181-a936-6815a6d8d1c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "affce264-2942-4aa8-850e-96642d84eff3", "tag": "166dd48f-5e8c-48ce-8be5-c39460c7ef08"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:08:36.987606 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-7caee3ed-bdb9-4e5b-a032-378bd9acd7c9 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:36.988341 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-7caee3ed-bdb9-4e5b-a032-378bd9acd7c9 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:37.004236 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7caee3ed-bdb9-4e5b-a032-378bd9acd7c9 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:37.010677 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-9997613b-3066-46b7-a7ff-6329d26c4800 req-8e3d60b0-dbb6-4181-a936-6815a6d8d1c0 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:37.010897 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7caee3ed-bdb9-4e5b-a032-378bd9acd7c9 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:37.010897 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7caee3ed-bdb9-4e5b-a032-378bd9acd7c9 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:37.010897 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7caee3ed-bdb9-4e5b-a032-378bd9acd7c9 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:37.011401 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-9997613b-3066-46b7-a7ff-6329d26c4800 req-8e3d60b0-dbb6-4181-a936-6815a6d8d1c0 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:37.037812 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-9997613b-3066-46b7-a7ff-6329d26c4800 req-8e3d60b0-dbb6-4181-a936-6815a6d8d1c0 service nova] Creating event network-changed:166dd48f-5e8c-48ce-8be5-c39460c7ef08 for instance affce264-2942-4aa8-850e-96642d84eff3 on hv-cinder-84762 Jun 25 16:08:37.058397 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-9997613b-3066-46b7-a7ff-6329d26c4800 req-8e3d60b0-dbb6-4181-a936-6815a6d8d1c0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089199 Jun 25 16:08:37.059367 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 143/286] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:08:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:08:37.376707 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-996ec37a-54ed-41f3-92a6-5337da136043 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:37.377786 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-996ec37a-54ed-41f3-92a6-5337da136043 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 24aa2353-f0e0-4f23-bc4c-e3567861148c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:37.386581 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-996ec37a-54ed-41f3-92a6-5337da136043 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:37.387034 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-996ec37a-54ed-41f3-92a6-5337da136043 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:37.388074 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-996ec37a-54ed-41f3-92a6-5337da136043 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:37.389164 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-996ec37a-54ed-41f3-92a6-5337da136043 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:37.481867 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-7caee3ed-bdb9-4e5b-a032-378bd9acd7c9 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:37.491259 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-7caee3ed-bdb9-4e5b-a032-378bd9acd7c9 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1260 microversion: 2.1 time: 0.507785 Jun 25 16:08:37.492876 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 144/287] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:36 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1260 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:08:37.810856 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-996ec37a-54ed-41f3-92a6-5337da136043 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:37.838910 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-996ec37a-54ed-41f3-92a6-5337da136043 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c" status: 200 len: 1314 microversion: 2.1 time: 0.467645 Jun 25 16:08:37.849785 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 144/288] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:37 2022] GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:38.356297 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-782d0e7e-0039-44ac-b0a4-d75b9be7f6a6 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4fcd22af-70a6-45a1-9650-8fac6706161b", "device": "/dev/sdb"}} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:08:38.358248 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-782d0e7e-0039-44ac-b0a4-d75b9be7f6a6 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 51391a15-1b93-4d73-9478-f803e617ca6a] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:38.365918 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-782d0e7e-0039-44ac-b0a4-d75b9be7f6a6 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:38.367324 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-782d0e7e-0039-44ac-b0a4-d75b9be7f6a6 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:38.367324 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-782d0e7e-0039-44ac-b0a4-d75b9be7f6a6 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:38.367760 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-782d0e7e-0039-44ac-b0a4-d75b9be7f6a6 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:38.509344 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-373a58f4-eac9-451f-b4c2-630c3aab7150 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:38.510127 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-373a58f4-eac9-451f-b4c2-630c3aab7150 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:38.516401 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:08:38.518196 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-373a58f4-eac9-451f-b4c2-630c3aab7150 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:38.518895 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-373a58f4-eac9-451f-b4c2-630c3aab7150 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:38.519783 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-373a58f4-eac9-451f-b4c2-630c3aab7150 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:38.520374 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-373a58f4-eac9-451f-b4c2-630c3aab7150 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:38.658245 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-782d0e7e-0039-44ac-b0a4-d75b9be7f6a6 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "POST /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305600 Jun 25 16:08:38.659190 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 145/289] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Jun 25 16:08:38 2022] POST /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 16:08:38.799707 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-373a58f4-eac9-451f-b4c2-630c3aab7150 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:38.813465 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-373a58f4-eac9-451f-b4c2-630c3aab7150 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1260 microversion: 2.1 time: 0.307751 Jun 25 16:08:38.823943 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 145/290] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:38 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1260 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:38.861510 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-7a5a0143-8ef5-443d-b801-4a5288e531e4 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:38.861510 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-7a5a0143-8ef5-443d-b801-4a5288e531e4 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 24aa2353-f0e0-4f23-bc4c-e3567861148c] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:38.863432 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:08:38.871834 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7a5a0143-8ef5-443d-b801-4a5288e531e4 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:38.872287 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7a5a0143-8ef5-443d-b801-4a5288e531e4 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:38.877042 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7a5a0143-8ef5-443d-b801-4a5288e531e4 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:38.878638 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7a5a0143-8ef5-443d-b801-4a5288e531e4 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:39.106140 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-35403f0f-d850-4e43-980c-e925036738d6 req-95c9412a-92cf-4e5d-bc99-f25f7111e9ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8de27285-8f18-4d98-b240-0042e68f7ff9", "tag": "17f4711f-55ed-463b-986b-2d3077795600"}, {"name": "network-changed", "server_uuid": "24aa2353-f0e0-4f23-bc4c-e3567861148c", "tag": "34bca296-41e2-4258-b3ae-a1610d0e7b08"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:08:39.116250 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-35403f0f-d850-4e43-980c-e925036738d6 req-95c9412a-92cf-4e5d-bc99-f25f7111e9ee service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:39.116716 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-35403f0f-d850-4e43-980c-e925036738d6 req-95c9412a-92cf-4e5d-bc99-f25f7111e9ee service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:39.131985 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-35403f0f-d850-4e43-980c-e925036738d6 req-95c9412a-92cf-4e5d-bc99-f25f7111e9ee service nova] Creating event network-changed:17f4711f-55ed-463b-986b-2d3077795600 for instance 8de27285-8f18-4d98-b240-0042e68f7ff9 on hv-cinder-84762 Jun 25 16:08:39.132609 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-35403f0f-d850-4e43-980c-e925036738d6 req-95c9412a-92cf-4e5d-bc99-f25f7111e9ee service nova] Creating event network-changed:34bca296-41e2-4258-b3ae-a1610d0e7b08 for instance 24aa2353-f0e0-4f23-bc4c-e3567861148c on hv-cinder-84762 Jun 25 16:08:39.139541 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-35403f0f-d850-4e43-980c-e925036738d6 req-95c9412a-92cf-4e5d-bc99-f25f7111e9ee service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037175 Jun 25 16:08:39.140692 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 146/291] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:08:39.208728 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-7a5a0143-8ef5-443d-b801-4a5288e531e4 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:39.216694 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-7a5a0143-8ef5-443d-b801-4a5288e531e4 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c" status: 200 len: 1314 microversion: 2.1 time: 0.362724 Jun 25 16:08:39.217858 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 146/292] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:38 2022] GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:39.831374 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9b9f90fc-d170-443e-b95d-e7e3977c103f tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:39.832066 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9b9f90fc-d170-443e-b95d-e7e3977c103f tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:39.839587 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9b9f90fc-d170-443e-b95d-e7e3977c103f tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:39.840029 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9b9f90fc-d170-443e-b95d-e7e3977c103f tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:39.840833 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9b9f90fc-d170-443e-b95d-e7e3977c103f tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:39.842435 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9b9f90fc-d170-443e-b95d-e7e3977c103f tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:40.121274 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9b9f90fc-d170-443e-b95d-e7e3977c103f tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:40.129051 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9b9f90fc-d170-443e-b95d-e7e3977c103f tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1260 microversion: 2.1 time: 0.301956 Jun 25 16:08:40.129692 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 147/293] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:39 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1260 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:40.237901 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-f061d6af-2493-413b-a1f5-ef0a6e032761 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:40.238958 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-f061d6af-2493-413b-a1f5-ef0a6e032761 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 24aa2353-f0e0-4f23-bc4c-e3567861148c] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:40.250109 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f061d6af-2493-413b-a1f5-ef0a6e032761 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:40.250863 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f061d6af-2493-413b-a1f5-ef0a6e032761 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:40.252165 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f061d6af-2493-413b-a1f5-ef0a6e032761 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:40.253003 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f061d6af-2493-413b-a1f5-ef0a6e032761 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:40.383519 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-f061d6af-2493-413b-a1f5-ef0a6e032761 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:40.391444 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-f061d6af-2493-413b-a1f5-ef0a6e032761 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c" status: 200 len: 1314 microversion: 2.1 time: 0.160132 Jun 25 16:08:40.392010 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 147/294] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:40 2022] GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:41.151211 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9d4b3547-7de2-4573-8a20-3eaa5330bce4 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:41.151833 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9d4b3547-7de2-4573-8a20-3eaa5330bce4 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:41.158868 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9d4b3547-7de2-4573-8a20-3eaa5330bce4 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:41.159318 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9d4b3547-7de2-4573-8a20-3eaa5330bce4 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:41.160092 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9d4b3547-7de2-4573-8a20-3eaa5330bce4 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:41.160643 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9d4b3547-7de2-4573-8a20-3eaa5330bce4 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:41.312494 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9d4b3547-7de2-4573-8a20-3eaa5330bce4 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:41.321334 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9d4b3547-7de2-4573-8a20-3eaa5330bce4 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1260 microversion: 2.1 time: 0.174065 Jun 25 16:08:41.321908 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 148/295] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:41 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:41.409515 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-a2b20173-904c-47ea-b08d-4f388836e295 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:41.410129 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-a2b20173-904c-47ea-b08d-4f388836e295 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 24aa2353-f0e0-4f23-bc4c-e3567861148c] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:41.419059 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a2b20173-904c-47ea-b08d-4f388836e295 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:41.419514 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a2b20173-904c-47ea-b08d-4f388836e295 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:41.420294 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a2b20173-904c-47ea-b08d-4f388836e295 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:41.420796 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a2b20173-904c-47ea-b08d-4f388836e295 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:41.583147 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-a2b20173-904c-47ea-b08d-4f388836e295 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:41.596143 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-a2b20173-904c-47ea-b08d-4f388836e295 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c" status: 200 len: 1314 microversion: 2.1 time: 0.191185 Jun 25 16:08:41.596961 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 148/296] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:41 2022] GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:42.339232 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-98bff16b-4503-4365-9c3b-9d212f159b81 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:42.339809 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-98bff16b-4503-4365-9c3b-9d212f159b81 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:42.346860 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-98bff16b-4503-4365-9c3b-9d212f159b81 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:42.347306 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-98bff16b-4503-4365-9c3b-9d212f159b81 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:42.348136 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-98bff16b-4503-4365-9c3b-9d212f159b81 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:42.348617 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-98bff16b-4503-4365-9c3b-9d212f159b81 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:42.485433 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-98bff16b-4503-4365-9c3b-9d212f159b81 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:42.493748 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-98bff16b-4503-4365-9c3b-9d212f159b81 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1260 microversion: 2.1 time: 0.158731 Jun 25 16:08:42.494294 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 149/297] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:42 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:42.620346 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-f249e4e4-0d2b-4ef6-9ba6-fd9464423e7f tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:42.621288 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-f249e4e4-0d2b-4ef6-9ba6-fd9464423e7f tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 24aa2353-f0e0-4f23-bc4c-e3567861148c] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:42.631432 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f249e4e4-0d2b-4ef6-9ba6-fd9464423e7f tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:42.631885 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f249e4e4-0d2b-4ef6-9ba6-fd9464423e7f tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:42.632688 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f249e4e4-0d2b-4ef6-9ba6-fd9464423e7f tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:42.633123 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f249e4e4-0d2b-4ef6-9ba6-fd9464423e7f tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:42.762310 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-f249e4e4-0d2b-4ef6-9ba6-fd9464423e7f tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:42.770320 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-f249e4e4-0d2b-4ef6-9ba6-fd9464423e7f tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c" status: 200 len: 1314 microversion: 2.1 time: 0.156988 Jun 25 16:08:42.770934 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 149/298] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:42 2022] GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:43.515273 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-226ab6eb-d2a3-4bb5-a9c2-c3e12dddd0d6 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:43.516256 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-226ab6eb-d2a3-4bb5-a9c2-c3e12dddd0d6 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:43.525129 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-226ab6eb-d2a3-4bb5-a9c2-c3e12dddd0d6 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:43.525580 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-226ab6eb-d2a3-4bb5-a9c2-c3e12dddd0d6 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:43.526348 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-226ab6eb-d2a3-4bb5-a9c2-c3e12dddd0d6 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:43.526786 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-226ab6eb-d2a3-4bb5-a9c2-c3e12dddd0d6 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:43.672256 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-226ab6eb-d2a3-4bb5-a9c2-c3e12dddd0d6 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:43.681573 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-226ab6eb-d2a3-4bb5-a9c2-c3e12dddd0d6 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1260 microversion: 2.1 time: 0.173153 Jun 25 16:08:43.682123 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 150/299] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:43 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:43.787355 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-0eca162c-bbcd-4d73-81cc-475ec1b58a79 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:43.787929 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-0eca162c-bbcd-4d73-81cc-475ec1b58a79 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 24aa2353-f0e0-4f23-bc4c-e3567861148c] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:43.789833 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell0:SELECT=2 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:08:43.790467 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell0:SELECT=8 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:08:43.796713 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0eca162c-bbcd-4d73-81cc-475ec1b58a79 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:43.797159 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0eca162c-bbcd-4d73-81cc-475ec1b58a79 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:43.797944 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0eca162c-bbcd-4d73-81cc-475ec1b58a79 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:43.798373 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0eca162c-bbcd-4d73-81cc-475ec1b58a79 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:43.936194 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-0eca162c-bbcd-4d73-81cc-475ec1b58a79 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:43.938801 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-5720927b-332f-432c-953a-69240dca0c83 req-d01c9715-e4f8-4016-820d-741d4df537bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24aa2353-f0e0-4f23-bc4c-e3567861148c", "name": "network-vif-plugged", "status": "completed", "tag": "34bca296-41e2-4258-b3ae-a1610d0e7b08"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:08:43.944831 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=8 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:08:43.944984 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-0eca162c-bbcd-4d73-81cc-475ec1b58a79 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c" status: 200 len: 1314 microversion: 2.1 time: 0.161504 Jun 25 16:08:43.945586 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 150/300] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:43 2022] GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:43.954291 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-5720927b-332f-432c-953a-69240dca0c83 req-d01c9715-e4f8-4016-820d-741d4df537bf service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:43.954291 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-5720927b-332f-432c-953a-69240dca0c83 req-d01c9715-e4f8-4016-820d-741d4df537bf service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:43.965184 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-5720927b-332f-432c-953a-69240dca0c83 req-d01c9715-e4f8-4016-820d-741d4df537bf service nova] Creating event network-vif-plugged:34bca296-41e2-4258-b3ae-a1610d0e7b08 for instance 24aa2353-f0e0-4f23-bc4c-e3567861148c on hv-cinder-84762 Jun 25 16:08:43.970550 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-5720927b-332f-432c-953a-69240dca0c83 req-d01c9715-e4f8-4016-820d-741d4df537bf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037079 Jun 25 16:08:43.971127 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 151/301] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:08:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 16:08:44.698302 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-9910cc2f-c7e2-4107-84be-926c281887ce tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:44.698915 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-9910cc2f-c7e2-4107-84be-926c281887ce tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:44.705132 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9910cc2f-c7e2-4107-84be-926c281887ce tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:44.705585 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9910cc2f-c7e2-4107-84be-926c281887ce tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:44.706344 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9910cc2f-c7e2-4107-84be-926c281887ce tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:44.706780 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9910cc2f-c7e2-4107-84be-926c281887ce tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:44.846454 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-9910cc2f-c7e2-4107-84be-926c281887ce tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:44.854461 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-9910cc2f-c7e2-4107-84be-926c281887ce tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1260 microversion: 2.1 time: 0.160123 Jun 25 16:08:44.855021 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 151/302] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:44 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:44.965567 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4dcd3ba6-ff3d-4388-ad4b-fd2015251070 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:44.966166 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4dcd3ba6-ff3d-4388-ad4b-fd2015251070 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 24aa2353-f0e0-4f23-bc4c-e3567861148c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:44.976572 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4dcd3ba6-ff3d-4388-ad4b-fd2015251070 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:44.977115 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4dcd3ba6-ff3d-4388-ad4b-fd2015251070 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:44.978210 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4dcd3ba6-ff3d-4388-ad4b-fd2015251070 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:44.978829 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4dcd3ba6-ff3d-4388-ad4b-fd2015251070 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:45.124146 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4dcd3ba6-ff3d-4388-ad4b-fd2015251070 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:45.132668 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4dcd3ba6-ff3d-4388-ad4b-fd2015251070 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c" status: 200 len: 1314 microversion: 2.1 time: 0.173496 Jun 25 16:08:45.133234 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 152/303] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:44 2022] GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:08:45.871019 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-3e849581-bc27-47c4-9164-33303d6e114a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:45.871627 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-3e849581-bc27-47c4-9164-33303d6e114a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:45.878443 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3e849581-bc27-47c4-9164-33303d6e114a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:45.878890 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3e849581-bc27-47c4-9164-33303d6e114a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:45.879803 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3e849581-bc27-47c4-9164-33303d6e114a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:45.880228 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3e849581-bc27-47c4-9164-33303d6e114a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:46.011524 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-3e849581-bc27-47c4-9164-33303d6e114a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:46.019748 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-3e849581-bc27-47c4-9164-33303d6e114a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1260 microversion: 2.1 time: 0.152541 Jun 25 16:08:46.020342 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 152/304] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:45 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:46.149741 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-140c8aac-fbcc-44b4-bfe5-b4202a2b0736 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:46.150419 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-140c8aac-fbcc-44b4-bfe5-b4202a2b0736 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 24aa2353-f0e0-4f23-bc4c-e3567861148c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:46.157472 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-140c8aac-fbcc-44b4-bfe5-b4202a2b0736 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:46.157983 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-140c8aac-fbcc-44b4-bfe5-b4202a2b0736 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:46.158808 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-140c8aac-fbcc-44b4-bfe5-b4202a2b0736 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:46.159304 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-140c8aac-fbcc-44b4-bfe5-b4202a2b0736 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:46.297474 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-140c8aac-fbcc-44b4-bfe5-b4202a2b0736 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:46.305481 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-140c8aac-fbcc-44b4-bfe5-b4202a2b0736 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c" status: 200 len: 1314 microversion: 2.1 time: 0.159691 Jun 25 16:08:46.306039 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 153/305] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:46 2022] GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:08:47.040843 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-654794a9-973a-4c27-a848-f1af12006af0 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:47.041772 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-654794a9-973a-4c27-a848-f1af12006af0 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:47.052206 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-654794a9-973a-4c27-a848-f1af12006af0 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:47.052947 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-654794a9-973a-4c27-a848-f1af12006af0 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:47.054111 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-654794a9-973a-4c27-a848-f1af12006af0 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:47.054777 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-654794a9-973a-4c27-a848-f1af12006af0 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:47.191880 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-654794a9-973a-4c27-a848-f1af12006af0 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:47.202428 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-654794a9-973a-4c27-a848-f1af12006af0 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1260 microversion: 2.1 time: 0.167969 Jun 25 16:08:47.203252 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 153/306] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:47 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:47.326613 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-704314c0-acbb-424c-9297-133b41b7920e tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:47.327590 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-704314c0-acbb-424c-9297-133b41b7920e tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 24aa2353-f0e0-4f23-bc4c-e3567861148c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:47.337317 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-704314c0-acbb-424c-9297-133b41b7920e tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:47.337763 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-704314c0-acbb-424c-9297-133b41b7920e tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:47.338518 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-704314c0-acbb-424c-9297-133b41b7920e tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:47.338952 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-704314c0-acbb-424c-9297-133b41b7920e tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:47.473803 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-704314c0-acbb-424c-9297-133b41b7920e tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:47.481726 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-704314c0-acbb-424c-9297-133b41b7920e tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c" status: 200 len: 1314 microversion: 2.1 time: 0.161577 Jun 25 16:08:47.482277 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 154/307] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:47 2022] GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:48.220399 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-68db69c8-df26-4ca3-ba8a-bc3967b4edfb tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:48.220993 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-68db69c8-df26-4ca3-ba8a-bc3967b4edfb tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:48.227890 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-68db69c8-df26-4ca3-ba8a-bc3967b4edfb tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:48.228343 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-68db69c8-df26-4ca3-ba8a-bc3967b4edfb tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:48.229105 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-68db69c8-df26-4ca3-ba8a-bc3967b4edfb tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:48.229572 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-68db69c8-df26-4ca3-ba8a-bc3967b4edfb tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:48.366498 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-68db69c8-df26-4ca3-ba8a-bc3967b4edfb tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:48.378929 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-68db69c8-df26-4ca3-ba8a-bc3967b4edfb tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1260 microversion: 2.1 time: 0.162192 Jun 25 16:08:48.379662 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 154/308] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:48 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:48.501875 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-efae3a06-889d-4f71-b990-fd9cf456b7cc tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:48.502592 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-efae3a06-889d-4f71-b990-fd9cf456b7cc tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 24aa2353-f0e0-4f23-bc4c-e3567861148c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:48.510000 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-efae3a06-889d-4f71-b990-fd9cf456b7cc tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:48.510455 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-efae3a06-889d-4f71-b990-fd9cf456b7cc tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:48.511222 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-efae3a06-889d-4f71-b990-fd9cf456b7cc tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:48.511661 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-efae3a06-889d-4f71-b990-fd9cf456b7cc tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:48.649454 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-efae3a06-889d-4f71-b990-fd9cf456b7cc tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:48.657579 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-efae3a06-889d-4f71-b990-fd9cf456b7cc tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c" status: 200 len: 1314 microversion: 2.1 time: 0.161559 Jun 25 16:08:48.658148 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 155/309] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:48 2022] GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:49.400545 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-44ea3887-a857-46b4-83e7-7e7a38ab6629 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:49.401469 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-44ea3887-a857-46b4-83e7-7e7a38ab6629 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:49.411742 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-44ea3887-a857-46b4-83e7-7e7a38ab6629 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:49.412202 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-44ea3887-a857-46b4-83e7-7e7a38ab6629 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:49.413004 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-44ea3887-a857-46b4-83e7-7e7a38ab6629 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:49.413435 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-44ea3887-a857-46b4-83e7-7e7a38ab6629 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:49.551612 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-44ea3887-a857-46b4-83e7-7e7a38ab6629 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:49.560083 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-44ea3887-a857-46b4-83e7-7e7a38ab6629 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1260 microversion: 2.1 time: 0.166069 Jun 25 16:08:49.560708 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 155/310] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:49 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:49.674789 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8c084f63-1eac-434a-a601-2b472b6817cc tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:49.675326 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8c084f63-1eac-434a-a601-2b472b6817cc tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 24aa2353-f0e0-4f23-bc4c-e3567861148c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:49.683288 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8c084f63-1eac-434a-a601-2b472b6817cc tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:49.683785 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8c084f63-1eac-434a-a601-2b472b6817cc tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:49.684813 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8c084f63-1eac-434a-a601-2b472b6817cc tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:49.685342 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8c084f63-1eac-434a-a601-2b472b6817cc tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:49.825257 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8c084f63-1eac-434a-a601-2b472b6817cc tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:49.833295 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8c084f63-1eac-434a-a601-2b472b6817cc tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c" status: 200 len: 1314 microversion: 2.1 time: 0.162485 Jun 25 16:08:49.833864 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 156/311] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:49 2022] GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:50.179473 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-18957536-c9d3-4b5a-9bd7-2bdb22adaf88 req-c63c233c-2a3a-44b1-8c6c-2522b06b4cdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "affce264-2942-4aa8-850e-96642d84eff3", "name": "network-vif-plugged", "status": "completed", "tag": "166dd48f-5e8c-48ce-8be5-c39460c7ef08"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:08:50.187929 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-18957536-c9d3-4b5a-9bd7-2bdb22adaf88 req-c63c233c-2a3a-44b1-8c6c-2522b06b4cdc service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:50.188392 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-18957536-c9d3-4b5a-9bd7-2bdb22adaf88 req-c63c233c-2a3a-44b1-8c6c-2522b06b4cdc service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:50.201887 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-18957536-c9d3-4b5a-9bd7-2bdb22adaf88 req-c63c233c-2a3a-44b1-8c6c-2522b06b4cdc service nova] Creating event network-vif-plugged:166dd48f-5e8c-48ce-8be5-c39460c7ef08 for instance affce264-2942-4aa8-850e-96642d84eff3 on hv-cinder-84762 Jun 25 16:08:50.207008 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-18957536-c9d3-4b5a-9bd7-2bdb22adaf88 req-c63c233c-2a3a-44b1-8c6c-2522b06b4cdc service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031198 Jun 25 16:08:50.207998 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 156/312] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:08:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:08:50.577800 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-85d7bf14-a9c9-4e3f-9739-96a950a699a1 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:50.578646 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-85d7bf14-a9c9-4e3f-9739-96a950a699a1 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:50.585833 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-85d7bf14-a9c9-4e3f-9739-96a950a699a1 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:50.586773 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-85d7bf14-a9c9-4e3f-9739-96a950a699a1 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:50.587696 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-85d7bf14-a9c9-4e3f-9739-96a950a699a1 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:50.588206 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-85d7bf14-a9c9-4e3f-9739-96a950a699a1 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:50.747483 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-85d7bf14-a9c9-4e3f-9739-96a950a699a1 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:50.755740 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-85d7bf14-a9c9-4e3f-9739-96a950a699a1 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1260 microversion: 2.1 time: 0.181841 Jun 25 16:08:50.756291 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 157/313] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:50 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:50.852190 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-47b57400-efa2-4233-a328-0ae743549496 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:50.852931 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-47b57400-efa2-4233-a328-0ae743549496 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 24aa2353-f0e0-4f23-bc4c-e3567861148c] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:50.860822 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-47b57400-efa2-4233-a328-0ae743549496 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:50.861272 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-47b57400-efa2-4233-a328-0ae743549496 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:50.862065 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-47b57400-efa2-4233-a328-0ae743549496 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:50.862502 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-47b57400-efa2-4233-a328-0ae743549496 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:51.001152 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-47b57400-efa2-4233-a328-0ae743549496 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:51.004765 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:08:51.009441 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-47b57400-efa2-4233-a328-0ae743549496 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c" status: 200 len: 1498 microversion: 2.1 time: 0.161781 Jun 25 16:08:51.010025 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 157/314] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:50 2022] GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c => generated 1498 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:51.772869 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-fe37e250-f445-40e4-862e-e1f3bcadb4fb tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:51.773443 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-fe37e250-f445-40e4-862e-e1f3bcadb4fb tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:51.780327 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fe37e250-f445-40e4-862e-e1f3bcadb4fb tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:51.780815 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fe37e250-f445-40e4-862e-e1f3bcadb4fb tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:51.781561 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fe37e250-f445-40e4-862e-e1f3bcadb4fb tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:51.782025 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fe37e250-f445-40e4-862e-e1f3bcadb4fb tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:51.800651 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=100 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:08:51.918809 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fe37e250-f445-40e4-862e-e1f3bcadb4fb tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:51.926699 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-fe37e250-f445-40e4-862e-e1f3bcadb4fb tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1260 microversion: 2.1 time: 0.158332 Jun 25 16:08:51.927253 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 158/315] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:51 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:52.944186 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-7ae229c4-2eb5-4d56-a2ad-49fac44e1c8a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:52.944996 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-7ae229c4-2eb5-4d56-a2ad-49fac44e1c8a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:52.952366 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7ae229c4-2eb5-4d56-a2ad-49fac44e1c8a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:52.952849 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7ae229c4-2eb5-4d56-a2ad-49fac44e1c8a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:52.953623 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7ae229c4-2eb5-4d56-a2ad-49fac44e1c8a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:52.954056 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7ae229c4-2eb5-4d56-a2ad-49fac44e1c8a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:53.347917 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-7ae229c4-2eb5-4d56-a2ad-49fac44e1c8a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:53.355531 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-7ae229c4-2eb5-4d56-a2ad-49fac44e1c8a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1260 microversion: 2.1 time: 0.415769 Jun 25 16:08:53.356072 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 158/316] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:52 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1260 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:54.246060 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8d7dc1e1-da30-43ed-ba4b-aa8ffb1279a4 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:54.246625 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8d7dc1e1-da30-43ed-ba4b-aa8ffb1279a4 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 24aa2353-f0e0-4f23-bc4c-e3567861148c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:54.256208 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8d7dc1e1-da30-43ed-ba4b-aa8ffb1279a4 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:54.256691 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8d7dc1e1-da30-43ed-ba4b-aa8ffb1279a4 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:54.257715 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8d7dc1e1-da30-43ed-ba4b-aa8ffb1279a4 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:54.258355 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8d7dc1e1-da30-43ed-ba4b-aa8ffb1279a4 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:54.286847 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8d7dc1e1-da30-43ed-ba4b-aa8ffb1279a4 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 24aa2353-f0e0-4f23-bc4c-e3567861148c] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 16:08:54.371933 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-2c9569d2-015b-4332-9428-fe0b9f8ebbb1 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:54.372509 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-2c9569d2-015b-4332-9428-fe0b9f8ebbb1 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:54.379863 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8d7dc1e1-da30-43ed-ba4b-aa8ffb1279a4 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "DELETE /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c" status: 204 len: 0 microversion: 2.1 time: 0.139329 Jun 25 16:08:54.380064 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2c9569d2-015b-4332-9428-fe0b9f8ebbb1 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:54.380456 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 159/317] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Jun 25 16:08:54 2022] DELETE /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 16:08:54.380613 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2c9569d2-015b-4332-9428-fe0b9f8ebbb1 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:54.381385 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2c9569d2-015b-4332-9428-fe0b9f8ebbb1 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:54.381825 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2c9569d2-015b-4332-9428-fe0b9f8ebbb1 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:54.388650 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a897299d-3fb1-481a-bac7-15a2837fa665 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:54.389388 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a897299d-3fb1-481a-bac7-15a2837fa665 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 24aa2353-f0e0-4f23-bc4c-e3567861148c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:54.395598 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a897299d-3fb1-481a-bac7-15a2837fa665 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:54.396038 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a897299d-3fb1-481a-bac7-15a2837fa665 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:54.396820 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a897299d-3fb1-481a-bac7-15a2837fa665 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:54.397246 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a897299d-3fb1-481a-bac7-15a2837fa665 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:54.571021 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-2c9569d2-015b-4332-9428-fe0b9f8ebbb1 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:54.579877 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-2c9569d2-015b-4332-9428-fe0b9f8ebbb1 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1260 microversion: 2.1 time: 0.211881 Jun 25 16:08:54.580464 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 159/318] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:54 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1260 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:08:54.595601 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a897299d-3fb1-481a-bac7-15a2837fa665 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:54.604714 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a897299d-3fb1-481a-bac7-15a2837fa665 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c" status: 200 len: 1504 microversion: 2.1 time: 0.219975 Jun 25 16:08:54.605275 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 160/319] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:54 2022] GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c => generated 1504 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:08:55.602469 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-7bffa5bc-45f3-4a2d-8fb6-52e780d58b35 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:55.603504 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-7bffa5bc-45f3-4a2d-8fb6-52e780d58b35 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:55.614107 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7bffa5bc-45f3-4a2d-8fb6-52e780d58b35 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:55.614547 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7bffa5bc-45f3-4a2d-8fb6-52e780d58b35 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:55.615300 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7bffa5bc-45f3-4a2d-8fb6-52e780d58b35 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:55.615732 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7bffa5bc-45f3-4a2d-8fb6-52e780d58b35 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:55.622061 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-656db174-7bfd-4e85-95d3-5e610d5a6f86 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:55.622661 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-656db174-7bfd-4e85-95d3-5e610d5a6f86 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 24aa2353-f0e0-4f23-bc4c-e3567861148c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:55.629550 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-656db174-7bfd-4e85-95d3-5e610d5a6f86 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:55.630000 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-656db174-7bfd-4e85-95d3-5e610d5a6f86 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:55.630769 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-656db174-7bfd-4e85-95d3-5e610d5a6f86 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:55.631199 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-656db174-7bfd-4e85-95d3-5e610d5a6f86 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:55.825352 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-7bffa5bc-45f3-4a2d-8fb6-52e780d58b35 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:55.829898 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-656db174-7bfd-4e85-95d3-5e610d5a6f86 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:55.833630 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-7bffa5bc-45f3-4a2d-8fb6-52e780d58b35 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1260 microversion: 2.1 time: 0.238541 Jun 25 16:08:55.834215 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 160/320] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:55 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1260 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:55.838864 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-656db174-7bfd-4e85-95d3-5e610d5a6f86 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c" status: 200 len: 1504 microversion: 2.1 time: 0.220695 Jun 25 16:08:55.842467 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 161/321] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:55 2022] GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c => generated 1504 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:56.852501 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-6f28abd9-7a42-4337-933f-c0556832812b tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:56.853099 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-6f28abd9-7a42-4337-933f-c0556832812b tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:56.856379 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3e824cb3-ca22-44b7-9fe7-9eca70621b61 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:56.857233 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3e824cb3-ca22-44b7-9fe7-9eca70621b61 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 24aa2353-f0e0-4f23-bc4c-e3567861148c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:56.860764 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6f28abd9-7a42-4337-933f-c0556832812b tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:56.860928 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6f28abd9-7a42-4337-933f-c0556832812b tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:56.861735 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6f28abd9-7a42-4337-933f-c0556832812b tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:56.862155 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6f28abd9-7a42-4337-933f-c0556832812b tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:56.864441 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3e824cb3-ca22-44b7-9fe7-9eca70621b61 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:56.864912 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3e824cb3-ca22-44b7-9fe7-9eca70621b61 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:56.865670 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3e824cb3-ca22-44b7-9fe7-9eca70621b61 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:56.866095 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3e824cb3-ca22-44b7-9fe7-9eca70621b61 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:57.056756 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-6f28abd9-7a42-4337-933f-c0556832812b tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:57.059812 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3e824cb3-ca22-44b7-9fe7-9eca70621b61 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:57.068048 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3e824cb3-ca22-44b7-9fe7-9eca70621b61 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c" status: 200 len: 1504 microversion: 2.1 time: 0.215420 Jun 25 16:08:57.068800 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 162/322] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:56 2022] GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c => generated 1504 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:57.074963 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-6f28abd9-7a42-4337-933f-c0556832812b tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1260 microversion: 2.1 time: 0.226575 Jun 25 16:08:57.075688 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 161/323] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:56 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1260 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:58.086429 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1ca3e31d-db15-4c9b-98c6-93be6c49e2e2 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:58.087019 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1ca3e31d-db15-4c9b-98c6-93be6c49e2e2 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 24aa2353-f0e0-4f23-bc4c-e3567861148c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:58.091383 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-3df77f0f-8afa-46b2-9ea7-fa2489707bc2 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:58.092060 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-3df77f0f-8afa-46b2-9ea7-fa2489707bc2 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:58.093264 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1ca3e31d-db15-4c9b-98c6-93be6c49e2e2 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:58.093716 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1ca3e31d-db15-4c9b-98c6-93be6c49e2e2 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:58.094482 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1ca3e31d-db15-4c9b-98c6-93be6c49e2e2 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:58.095233 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1ca3e31d-db15-4c9b-98c6-93be6c49e2e2 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:58.099222 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3df77f0f-8afa-46b2-9ea7-fa2489707bc2 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:58.099675 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3df77f0f-8afa-46b2-9ea7-fa2489707bc2 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:58.100463 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3df77f0f-8afa-46b2-9ea7-fa2489707bc2 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:58.101100 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3df77f0f-8afa-46b2-9ea7-fa2489707bc2 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:58.295302 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1ca3e31d-db15-4c9b-98c6-93be6c49e2e2 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:58.298621 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-3df77f0f-8afa-46b2-9ea7-fa2489707bc2 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:58.303147 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1ca3e31d-db15-4c9b-98c6-93be6c49e2e2 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c" status: 200 len: 1504 microversion: 2.1 time: 0.221648 Jun 25 16:08:58.303824 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 163/324] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:58 2022] GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c => generated 1504 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:58.306666 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-3df77f0f-8afa-46b2-9ea7-fa2489707bc2 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1260 microversion: 2.1 time: 0.219453 Jun 25 16:08:58.307339 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 162/325] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:58 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1260 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:59.321312 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-cb9f2ff0-ccaa-4dce-885c-02ce9b961778 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:59.322120 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-cb9f2ff0-ccaa-4dce-885c-02ce9b961778 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 24aa2353-f0e0-4f23-bc4c-e3567861148c] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:59.323048 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-d6c8fd2c-05e4-44d7-a96d-8600ea04f8e4 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:59.323658 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-d6c8fd2c-05e4-44d7-a96d-8600ea04f8e4 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:59.329529 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cb9f2ff0-ccaa-4dce-885c-02ce9b961778 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:59.329978 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cb9f2ff0-ccaa-4dce-885c-02ce9b961778 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:59.330261 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d6c8fd2c-05e4-44d7-a96d-8600ea04f8e4 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:59.330756 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cb9f2ff0-ccaa-4dce-885c-02ce9b961778 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:59.330864 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d6c8fd2c-05e4-44d7-a96d-8600ea04f8e4 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:59.331190 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cb9f2ff0-ccaa-4dce-885c-02ce9b961778 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:59.331650 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d6c8fd2c-05e4-44d7-a96d-8600ea04f8e4 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:59.332130 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d6c8fd2c-05e4-44d7-a96d-8600ea04f8e4 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:59.557638 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d6c8fd2c-05e4-44d7-a96d-8600ea04f8e4 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:59.560161 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-cb9f2ff0-ccaa-4dce-885c-02ce9b961778 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:59.567367 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-d6c8fd2c-05e4-44d7-a96d-8600ea04f8e4 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1445 microversion: 2.1 time: 0.248186 Jun 25 16:08:59.568560 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 163/326] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:59 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1445 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:08:59.568854 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-cb9f2ff0-ccaa-4dce-885c-02ce9b961778 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c" status: 200 len: 1504 microversion: 2.1 time: 0.252345 Jun 25 16:08:59.569570 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 164/327] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:59 2022] GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c => generated 1504 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:59.585278 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-7af872c4-439c-43e5-ac65-f59c7a82b3bf tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:08:59.586127 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-7af872c4-439c-43e5-ac65-f59c7a82b3bf tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:08:59.592893 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7af872c4-439c-43e5-ac65-f59c7a82b3bf tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:59.593357 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7af872c4-439c-43e5-ac65-f59c7a82b3bf tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:59.594141 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7af872c4-439c-43e5-ac65-f59c7a82b3bf tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:59.594577 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7af872c4-439c-43e5-ac65-f59c7a82b3bf tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:59.737805 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-7af872c4-439c-43e5-ac65-f59c7a82b3bf tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:08:59.746534 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-7af872c4-439c-43e5-ac65-f59c7a82b3bf tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1445 microversion: 2.1 time: 0.166064 Jun 25 16:08:59.747228 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 164/328] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:08:59 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1445 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:08:59.784267 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-69dbbf99-50a5-4cf9-8fe2-dddf713e78c5 req-5950e5cb-46ef-47d8-8ab0-563996969354 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24aa2353-f0e0-4f23-bc4c-e3567861148c", "name": "network-vif-deleted", "tag": "34bca296-41e2-4258-b3ae-a1610d0e7b08"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:08:59.792881 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-69dbbf99-50a5-4cf9-8fe2-dddf713e78c5 req-5950e5cb-46ef-47d8-8ab0-563996969354 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:08:59.793318 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-69dbbf99-50a5-4cf9-8fe2-dddf713e78c5 req-5950e5cb-46ef-47d8-8ab0-563996969354 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:08:59.806761 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-69dbbf99-50a5-4cf9-8fe2-dddf713e78c5 req-5950e5cb-46ef-47d8-8ab0-563996969354 service nova] Creating event network-vif-deleted:34bca296-41e2-4258-b3ae-a1610d0e7b08 for instance 24aa2353-f0e0-4f23-bc4c-e3567861148c on hv-cinder-84762 Jun 25 16:08:59.811809 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-69dbbf99-50a5-4cf9-8fe2-dddf713e78c5 req-5950e5cb-46ef-47d8-8ab0-563996969354 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031333 Jun 25 16:08:59.813083 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 165/329] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:09:00.585742 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-e715cfd3-7c03-45df-946a-6fe0e26c0694 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:00.586325 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-e715cfd3-7c03-45df-946a-6fe0e26c0694 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 24aa2353-f0e0-4f23-bc4c-e3567861148c] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:00.593253 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e715cfd3-7c03-45df-946a-6fe0e26c0694 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:00.593701 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e715cfd3-7c03-45df-946a-6fe0e26c0694 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:00.594462 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e715cfd3-7c03-45df-946a-6fe0e26c0694 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:00.595048 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e715cfd3-7c03-45df-946a-6fe0e26c0694 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:00.609074 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.wsgi [None req-e715cfd3-7c03-45df-946a-6fe0e26c0694 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] HTTP exception thrown: Instance 24aa2353-f0e0-4f23-bc4c-e3567861148c could not be found. Jun 25 16:09:00.610760 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-e715cfd3-7c03-45df-946a-6fe0e26c0694 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Request method failure captured: Jun 25 16:09:00.610760 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: request: GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c HTTP/1.1 Jun 25 16:09:00.610760 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept: application/json Jun 25 16:09:00.610760 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept-Encoding: identity Jun 25 16:09:00.610760 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Connection: close Jun 25 16:09:00.610760 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Length: 0 Jun 25 16:09:00.610760 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Type: application/json Jun 25 16:09:00.610760 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Host: 10.222.0.13 Jun 25 16:09:00.610760 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Openstack-System-Scope: None Jun 25 16:09:00.610760 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: User-Agent: python-urllib3/1.26.9 Jun 25 16:09:00.610760 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Auth-Token: gAAAAABitzL-x5nog9BNVqbX0j4E4WJZgkLecoU5pbkSx1AexwzVTGl9Rp4aqJ03CVnzTDaY6l7fE130415xC29bhxAg4RBFWk_V693aSP1aJtukp9oqvmTpKx5eG_WzVN0bCPg_BI5VMCnFMJYJJMUYUweq2t_gJ-pzRMBt24We2kI_RtYXQAI Jun 25 16:09:00.610760 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Id: None Jun 25 16:09:00.610760 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Name: None Jun 25 16:09:00.610760 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Identity-Status: Confirmed Jun 25 16:09:00.610760 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Is-Admin-Project: True Jun 25 16:09:00.610760 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Id: default Jun 25 16:09:00.610760 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Name: Default Jun 25 16:09:00.610760 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Id: be35accfa19641058c6452311878f2d4 Jun 25 16:09:00.610760 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Name: tempest-VolumesActionsTest-999016632 Jun 25 16:09:00.610760 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Role: reader,member Jun 25 16:09:00.610760 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Roles: reader,member Jun 25 16:09:00.612448 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/be35accfa19641058c6452311878f2d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/be35accfa19641058c6452311878f2d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_be35accfa19641058c6452311878f2d4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/be35accfa19641058c6452311878f2d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:09:00.612448 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant: tempest-VolumesActionsTest-999016632 Jun 25 16:09:00.612448 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Id: be35accfa19641058c6452311878f2d4 Jun 25 16:09:00.612448 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Name: tempest-VolumesActionsTest-999016632 Jun 25 16:09:00.612448 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User: tempest-VolumesActionsTest-999016632-project Jun 25 16:09:00.612448 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Id: default Jun 25 16:09:00.612448 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Name: Default Jun 25 16:09:00.612448 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Id: bbf2525354424683bfa550eadc0a748c Jun 25 16:09:00.612448 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Name: tempest-VolumesActionsTest-999016632-project Jun 25 16:09:00.612448 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: method: > Jun 25 16:09:00.612448 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: exception: Instance 24aa2353-f0e0-4f23-bc4c-e3567861148c could not be found. Jun 25 16:09:00.612448 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: action_args: {'id': '24aa2353-f0e0-4f23-bc4c-e3567861148c'} Jun 25 16:09:00.613599 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:09:00.613599 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:09:00.613599 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:09:00.613599 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:09:00.613599 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:09:00.613599 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:09:00.613599 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:09:00.613599 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:09:00.613599 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:09:00.613599 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:09:00.613599 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24aa2353-f0e0-4f23-bc4c-e3567861148c could not be found. Jun 25 16:09:00.613599 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:09:00.613599 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:09:00.613599 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:09:00.613599 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:09:00.613599 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:09:00.613599 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:09:00.613599 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:09:00.613599 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:09:00.613599 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:09:00.615098 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:09:00.615098 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 16:09:00.615098 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 16:09:00.615098 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:09:00.615098 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:09:00.615098 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:09:00.615098 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:09:00.615098 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24aa2353-f0e0-4f23-bc4c-e3567861148c could not be found. Jun 25 16:09:00.615098 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:09:00.615098 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:09:00.615098 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:09:00.615098 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:09:00.615098 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:09:00.615098 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:09:00.615098 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:09:00.615098 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:09:00.615098 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24aa2353-f0e0-4f23-bc4c-e3567861148c could not be found. Jun 25 16:09:00.615098 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:09:00.617027 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-e715cfd3-7c03-45df-946a-6fe0e26c0694 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Returning 404 to user: Instance 24aa2353-f0e0-4f23-bc4c-e3567861148c could not be found. {{(pid=117794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:09:00.617027 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-e715cfd3-7c03-45df-946a-6fe0e26c0694 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c" status: 404 len: 111 microversion: 2.1 time: 0.030425 Jun 25 16:09:00.617027 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 165/330] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:00 2022] GET /compute/v2.1/servers/24aa2353-f0e0-4f23-bc4c-e3567861148c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:09:00.725029 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ca917fa7-fc04-45ed-a8bc-55fe08cd51b2 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1708085496", "imageRef": "84c164fa-276d-4693-b7a0-24fd3024b359", "flavorRef": "452", "networks": [{"uuid": "31bcb26d-3ca1-4959-a614-488af5d3fcfe"}]}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:09:00.778035 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-ca917fa7-fc04-45ed-a8bc-55fe08cd51b2 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] validate_networks() for [('31bcb26d-3ca1-4959-a614-488af5d3fcfe', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 16:09:01.331944 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-ca917fa7-fc04-45ed-a8bc-55fe08cd51b2 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 16:09:01.332370 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-ca917fa7-fc04-45ed-a8bc-55fe08cd51b2 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 16:09:01.332854 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-ca917fa7-fc04-45ed-a8bc-55fe08cd51b2 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 16:09:01.333250 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-ca917fa7-fc04-45ed-a8bc-55fe08cd51b2 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 16:09:01.333648 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-ca917fa7-fc04-45ed-a8bc-55fe08cd51b2 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 16:09:01.343090 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ca917fa7-fc04-45ed-a8bc-55fe08cd51b2 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:01.343528 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ca917fa7-fc04-45ed-a8bc-55fe08cd51b2 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:01.344303 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ca917fa7-fc04-45ed-a8bc-55fe08cd51b2 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:01.344759 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ca917fa7-fc04-45ed-a8bc-55fe08cd51b2 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:01.372295 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-ca917fa7-fc04-45ed-a8bc-55fe08cd51b2 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Getting quotas for project be35accfa19641058c6452311878f2d4. Resources: {'ram', 'cores', 'instances'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:09:01.377158 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-ca917fa7-fc04-45ed-a8bc-55fe08cd51b2 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Getting quotas for user bbf2525354424683bfa550eadc0a748c and project be35accfa19641058c6452311878f2d4. Resources: {'ram', 'cores', 'instances'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:09:01.389459 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ca917fa7-fc04-45ed-a8bc-55fe08cd51b2 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 16:09:01.392123 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ca917fa7-fc04-45ed-a8bc-55fe08cd51b2 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 679fe627-88a7-42af-99d9-aefdf5b03b3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84c164fa-276d-4693-b7a0-24fd3024b359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 16:09:01.445366 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ca917fa7-fc04-45ed-a8bc-55fe08cd51b2 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.725219 Jun 25 16:09:01.451914 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 166/331] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Jun 25 16:09:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 16:09:01.457728 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-6d410d0e-9296-418f-8126-9bab69bf8d4e tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:01.458954 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-6d410d0e-9296-418f-8126-9bab69bf8d4e tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 679fe627-88a7-42af-99d9-aefdf5b03b3d] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:01.536665 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-6d410d0e-9296-418f-8126-9bab69bf8d4e tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:01.544115 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-6d410d0e-9296-418f-8126-9bab69bf8d4e tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d" status: 200 len: 1214 microversion: 2.1 time: 0.090665 Jun 25 16:09:01.544942 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 166/332] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:01 2022] GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:02.196892 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-b6daaf4f-bd8a-4b96-bbfa-c276805ad348 req-8e71dae3-d674-4ea1-ad2e-c4e8b8f978d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "affce264-2942-4aa8-850e-96642d84eff3", "tag": "166dd48f-5e8c-48ce-8be5-c39460c7ef08"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:09:02.206091 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-b6daaf4f-bd8a-4b96-bbfa-c276805ad348 req-8e71dae3-d674-4ea1-ad2e-c4e8b8f978d5 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:02.206522 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-b6daaf4f-bd8a-4b96-bbfa-c276805ad348 req-8e71dae3-d674-4ea1-ad2e-c4e8b8f978d5 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:02.217547 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-b6daaf4f-bd8a-4b96-bbfa-c276805ad348 req-8e71dae3-d674-4ea1-ad2e-c4e8b8f978d5 service nova] Creating event network-changed:166dd48f-5e8c-48ce-8be5-c39460c7ef08 for instance affce264-2942-4aa8-850e-96642d84eff3 on hv-cinder-84762 Jun 25 16:09:02.222430 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-b6daaf4f-bd8a-4b96-bbfa-c276805ad348 req-8e71dae3-d674-4ea1-ad2e-c4e8b8f978d5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029829 Jun 25 16:09:02.223207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 167/333] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 16:09:02.499347 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-e600d2d9-1a52-40ab-a485-7f910005c93b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:02.501042 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-e600d2d9-1a52-40ab-a485-7f910005c93b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 51391a15-1b93-4d73-9478-f803e617ca6a] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:02.509180 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e600d2d9-1a52-40ab-a485-7f910005c93b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:02.509771 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e600d2d9-1a52-40ab-a485-7f910005c93b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:02.510652 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e600d2d9-1a52-40ab-a485-7f910005c93b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:02.511183 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e600d2d9-1a52-40ab-a485-7f910005c93b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:02.562836 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1e94c50b-9741-4979-bbad-39805b638a9f tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:02.564085 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1e94c50b-9741-4979-bbad-39805b638a9f tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 679fe627-88a7-42af-99d9-aefdf5b03b3d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:02.576230 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1e94c50b-9741-4979-bbad-39805b638a9f tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:02.579708 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1e94c50b-9741-4979-bbad-39805b638a9f tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:02.580633 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1e94c50b-9741-4979-bbad-39805b638a9f tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:02.581141 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1e94c50b-9741-4979-bbad-39805b638a9f tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:02.701031 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.objects.instance [None req-e600d2d9-1a52-40ab-a485-7f910005c93b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lazy-loading 'services' on Instance uuid 51391a15-1b93-4d73-9478-f803e617ca6a {{(pid=117794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 16:09:02.719990 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1e94c50b-9741-4979-bbad-39805b638a9f tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:02.730521 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1e94c50b-9741-4979-bbad-39805b638a9f tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d" status: 200 len: 1266 microversion: 2.1 time: 0.170524 Jun 25 16:09:02.731060 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 168/334] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:02 2022] GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:09:02.923026 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-e600d2d9-1a52-40ab-a485-7f910005c93b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "DELETE /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a/os-volume_attachments/4fcd22af-70a6-45a1-9650-8fac6706161b" status: 202 len: 0 microversion: 2.1 time: 0.428851 Jun 25 16:09:02.924621 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 167/335] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Jun 25 16:09:02 2022] DELETE /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a/os-volume_attachments/4fcd22af-70a6-45a1-9650-8fac6706161b => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 16:09:03.747485 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8ac75224-812d-4e4d-9565-49a8973b77d8 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:03.748055 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8ac75224-812d-4e4d-9565-49a8973b77d8 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 679fe627-88a7-42af-99d9-aefdf5b03b3d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:03.750694 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:09:03.757095 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8ac75224-812d-4e4d-9565-49a8973b77d8 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:03.757547 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8ac75224-812d-4e4d-9565-49a8973b77d8 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:03.758499 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8ac75224-812d-4e4d-9565-49a8973b77d8 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:03.759078 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8ac75224-812d-4e4d-9565-49a8973b77d8 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:04.015532 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8ac75224-812d-4e4d-9565-49a8973b77d8 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:04.023721 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8ac75224-812d-4e4d-9565-49a8973b77d8 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d" status: 200 len: 1314 microversion: 2.1 time: 0.280067 Jun 25 16:09:04.024384 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 169/336] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:03 2022] GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:04.389673 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-8e99fd2d-6312-4102-86db-3911c2c89898 req-f4406fd4-6607-4413-92bf-7d023da30c40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "679fe627-88a7-42af-99d9-aefdf5b03b3d", "tag": "d3721cff-9dc7-44e9-9f72-4de800e8d602"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:09:04.400048 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-8e99fd2d-6312-4102-86db-3911c2c89898 req-f4406fd4-6607-4413-92bf-7d023da30c40 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:04.400722 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-8e99fd2d-6312-4102-86db-3911c2c89898 req-f4406fd4-6607-4413-92bf-7d023da30c40 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:04.418159 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-8e99fd2d-6312-4102-86db-3911c2c89898 req-f4406fd4-6607-4413-92bf-7d023da30c40 service nova] Creating event network-changed:d3721cff-9dc7-44e9-9f72-4de800e8d602 for instance 679fe627-88a7-42af-99d9-aefdf5b03b3d on hv-cinder-84762 Jun 25 16:09:04.422623 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-8e99fd2d-6312-4102-86db-3911c2c89898 req-f4406fd4-6607-4413-92bf-7d023da30c40 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037710 Jun 25 16:09:04.423161 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 168/337] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:09:05.045704 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8875e1d0-51e7-4ede-a2af-c90cb5b41896 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:05.046634 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8875e1d0-51e7-4ede-a2af-c90cb5b41896 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 679fe627-88a7-42af-99d9-aefdf5b03b3d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:05.057983 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8875e1d0-51e7-4ede-a2af-c90cb5b41896 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:05.058702 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8875e1d0-51e7-4ede-a2af-c90cb5b41896 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:05.059957 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8875e1d0-51e7-4ede-a2af-c90cb5b41896 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:05.060746 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8875e1d0-51e7-4ede-a2af-c90cb5b41896 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:05.111068 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-792942f8-3ce0-4585-a411-6a155d5dbc7d tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:05.111649 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-792942f8-3ce0-4585-a411-6a155d5dbc7d tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 51391a15-1b93-4d73-9478-f803e617ca6a] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:05.118226 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-792942f8-3ce0-4585-a411-6a155d5dbc7d tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:05.118681 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-792942f8-3ce0-4585-a411-6a155d5dbc7d tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:05.119440 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-792942f8-3ce0-4585-a411-6a155d5dbc7d tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:05.119871 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-792942f8-3ce0-4585-a411-6a155d5dbc7d tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:05.148037 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-792942f8-3ce0-4585-a411-6a155d5dbc7d tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 51391a15-1b93-4d73-9478-f803e617ca6a] Going to try to terminate instance {{(pid=117794) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 16:09:05.194877 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8875e1d0-51e7-4ede-a2af-c90cb5b41896 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:05.202537 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8875e1d0-51e7-4ede-a2af-c90cb5b41896 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d" status: 200 len: 1314 microversion: 2.1 time: 0.163523 Jun 25 16:09:05.203203 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 170/338] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:05 2022] GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:05.228706 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-792942f8-3ce0-4585-a411-6a155d5dbc7d tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "DELETE /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a" status: 204 len: 0 microversion: 2.1 time: 0.121644 Jun 25 16:09:05.229276 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 169/339] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Jun 25 16:09:05 2022] DELETE /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 16:09:05.237478 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2f200488-88e9-4c2e-955c-669cfcaa613e tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:05.238154 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2f200488-88e9-4c2e-955c-669cfcaa613e tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 51391a15-1b93-4d73-9478-f803e617ca6a] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:05.244202 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f200488-88e9-4c2e-955c-669cfcaa613e tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:05.244701 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f200488-88e9-4c2e-955c-669cfcaa613e tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:05.245482 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f200488-88e9-4c2e-955c-669cfcaa613e tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:05.245886 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f200488-88e9-4c2e-955c-669cfcaa613e tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:05.390442 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2f200488-88e9-4c2e-955c-669cfcaa613e tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:05.398704 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2f200488-88e9-4c2e-955c-669cfcaa613e tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a" status: 200 len: 1514 microversion: 2.1 time: 0.165126 Jun 25 16:09:05.399276 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 171/340] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:05 2022] GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a => generated 1514 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:09:06.221174 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-a7730d00-c18b-4f3d-b597-c5431db78c5f tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:06.221888 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-a7730d00-c18b-4f3d-b597-c5431db78c5f tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 679fe627-88a7-42af-99d9-aefdf5b03b3d] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:06.228942 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a7730d00-c18b-4f3d-b597-c5431db78c5f tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:06.229394 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a7730d00-c18b-4f3d-b597-c5431db78c5f tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:06.230154 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a7730d00-c18b-4f3d-b597-c5431db78c5f tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:06.230586 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a7730d00-c18b-4f3d-b597-c5431db78c5f tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:06.374555 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-a7730d00-c18b-4f3d-b597-c5431db78c5f tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:06.384079 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-a7730d00-c18b-4f3d-b597-c5431db78c5f tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d" status: 200 len: 1314 microversion: 2.1 time: 0.167191 Jun 25 16:09:06.384594 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 170/341] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:06 2022] GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:06.416326 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-58795951-ea67-45b2-8741-c5cb50744b33 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:06.416920 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-58795951-ea67-45b2-8741-c5cb50744b33 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 51391a15-1b93-4d73-9478-f803e617ca6a] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:06.423386 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-58795951-ea67-45b2-8741-c5cb50744b33 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:06.423823 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-58795951-ea67-45b2-8741-c5cb50744b33 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:06.424621 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-58795951-ea67-45b2-8741-c5cb50744b33 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:06.425052 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-58795951-ea67-45b2-8741-c5cb50744b33 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:06.562599 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-58795951-ea67-45b2-8741-c5cb50744b33 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:06.572049 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-58795951-ea67-45b2-8741-c5cb50744b33 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a" status: 200 len: 1514 microversion: 2.1 time: 0.159736 Jun 25 16:09:06.572703 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 172/342] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:06 2022] GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a => generated 1514 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:07.405502 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-6cf3b297-7b9d-4960-b40d-00bdc65de7c6 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:07.406317 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-6cf3b297-7b9d-4960-b40d-00bdc65de7c6 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 679fe627-88a7-42af-99d9-aefdf5b03b3d] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:07.414822 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6cf3b297-7b9d-4960-b40d-00bdc65de7c6 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:07.415296 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6cf3b297-7b9d-4960-b40d-00bdc65de7c6 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:07.416064 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6cf3b297-7b9d-4960-b40d-00bdc65de7c6 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:07.416531 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6cf3b297-7b9d-4960-b40d-00bdc65de7c6 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:07.553087 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-6cf3b297-7b9d-4960-b40d-00bdc65de7c6 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:07.565331 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-6cf3b297-7b9d-4960-b40d-00bdc65de7c6 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d" status: 200 len: 1314 microversion: 2.1 time: 0.166148 Jun 25 16:09:07.566226 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 171/343] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:07 2022] GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:07.589339 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-15185cab-3a7e-4e94-802c-eb47be095851 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:07.589914 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-15185cab-3a7e-4e94-802c-eb47be095851 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 51391a15-1b93-4d73-9478-f803e617ca6a] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:07.596765 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-15185cab-3a7e-4e94-802c-eb47be095851 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:07.597192 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-15185cab-3a7e-4e94-802c-eb47be095851 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:07.598118 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-15185cab-3a7e-4e94-802c-eb47be095851 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:07.598545 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-15185cab-3a7e-4e94-802c-eb47be095851 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:07.744262 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-15185cab-3a7e-4e94-802c-eb47be095851 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:07.751855 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-15185cab-3a7e-4e94-802c-eb47be095851 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a" status: 200 len: 1514 microversion: 2.1 time: 0.166468 Jun 25 16:09:07.752434 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 173/344] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:07 2022] GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a => generated 1514 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:08.583196 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-ee812826-1eee-4a6e-9d5b-4bb0c3a77988 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:08.583960 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-ee812826-1eee-4a6e-9d5b-4bb0c3a77988 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 679fe627-88a7-42af-99d9-aefdf5b03b3d] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:08.590674 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ee812826-1eee-4a6e-9d5b-4bb0c3a77988 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:08.591126 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ee812826-1eee-4a6e-9d5b-4bb0c3a77988 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:08.591902 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ee812826-1eee-4a6e-9d5b-4bb0c3a77988 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:08.592337 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ee812826-1eee-4a6e-9d5b-4bb0c3a77988 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:08.632607 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-b9d3b6e0-08b9-42bc-b56b-8eac315005dd req-7deb744c-1d6e-4f4a-8f25-8bfddb5d19d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51391a15-1b93-4d73-9478-f803e617ca6a", "name": "network-vif-deleted", "tag": "eb3518e7-515a-4327-8691-c7824f8989cd"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:09:08.661025 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-b9d3b6e0-08b9-42bc-b56b-8eac315005dd req-7deb744c-1d6e-4f4a-8f25-8bfddb5d19d4 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:08.661906 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-b9d3b6e0-08b9-42bc-b56b-8eac315005dd req-7deb744c-1d6e-4f4a-8f25-8bfddb5d19d4 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:08.674255 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-b9d3b6e0-08b9-42bc-b56b-8eac315005dd req-7deb744c-1d6e-4f4a-8f25-8bfddb5d19d4 service nova] Creating event network-vif-deleted:eb3518e7-515a-4327-8691-c7824f8989cd for instance 51391a15-1b93-4d73-9478-f803e617ca6a on hv-cinder-84762 Jun 25 16:09:08.679366 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-b9d3b6e0-08b9-42bc-b56b-8eac315005dd req-7deb744c-1d6e-4f4a-8f25-8bfddb5d19d4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050872 Jun 25 16:09:08.680250 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 174/345] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:09:08.740555 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-ee812826-1eee-4a6e-9d5b-4bb0c3a77988 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:08.748448 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-ee812826-1eee-4a6e-9d5b-4bb0c3a77988 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d" status: 200 len: 1314 microversion: 2.1 time: 0.169804 Jun 25 16:09:08.759823 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 172/346] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:08 2022] GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:08.776329 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-57849d1a-4011-42d8-a9e7-62a717685f86 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:08.777275 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-57849d1a-4011-42d8-a9e7-62a717685f86 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 51391a15-1b93-4d73-9478-f803e617ca6a] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:08.784002 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-57849d1a-4011-42d8-a9e7-62a717685f86 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:08.784580 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-57849d1a-4011-42d8-a9e7-62a717685f86 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:08.785864 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-57849d1a-4011-42d8-a9e7-62a717685f86 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:08.786380 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-57849d1a-4011-42d8-a9e7-62a717685f86 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:08.817513 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-57849d1a-4011-42d8-a9e7-62a717685f86 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:08.818194 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-57849d1a-4011-42d8-a9e7-62a717685f86 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:08.818651 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-57849d1a-4011-42d8-a9e7-62a717685f86 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lazy-loading 'fault' on Instance uuid 51391a15-1b93-4d73-9478-f803e617ca6a {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 16:09:08.860230 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-57849d1a-4011-42d8-a9e7-62a717685f86 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:08.864389 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:09:08.869256 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-57849d1a-4011-42d8-a9e7-62a717685f86 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a" status: 200 len: 1309 microversion: 2.1 time: 0.097605 Jun 25 16:09:08.869837 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 175/347] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:08 2022] GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:09.771524 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-7c3a18b0-0d16-4522-95c7-a28f31533bef tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:09.772128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-7c3a18b0-0d16-4522-95c7-a28f31533bef tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 679fe627-88a7-42af-99d9-aefdf5b03b3d] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:09.774996 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:09:09.782671 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7c3a18b0-0d16-4522-95c7-a28f31533bef tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:09.783319 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7c3a18b0-0d16-4522-95c7-a28f31533bef tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:09.784344 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7c3a18b0-0d16-4522-95c7-a28f31533bef tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:09.785057 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7c3a18b0-0d16-4522-95c7-a28f31533bef tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:09.886698 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-33c73009-271d-4ca8-b29d-41abde42df06 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:09.887714 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-33c73009-271d-4ca8-b29d-41abde42df06 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 51391a15-1b93-4d73-9478-f803e617ca6a] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:09.895856 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-33c73009-271d-4ca8-b29d-41abde42df06 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:09.896306 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-33c73009-271d-4ca8-b29d-41abde42df06 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:09.897110 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-33c73009-271d-4ca8-b29d-41abde42df06 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:09.897677 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-33c73009-271d-4ca8-b29d-41abde42df06 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:09.912992 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-33c73009-271d-4ca8-b29d-41abde42df06 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] HTTP exception thrown: Instance 51391a15-1b93-4d73-9478-f803e617ca6a could not be found. Jun 25 16:09:09.914661 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-33c73009-271d-4ca8-b29d-41abde42df06 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Request method failure captured: Jun 25 16:09:09.914661 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a HTTP/1.1 Jun 25 16:09:09.914661 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept: application/json Jun 25 16:09:09.914661 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jun 25 16:09:09.914661 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Connection: close Jun 25 16:09:09.914661 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jun 25 16:09:09.914661 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jun 25 16:09:09.914661 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Host: 10.222.0.13 Jun 25 16:09:09.914661 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jun 25 16:09:09.914661 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jun 25 16:09:09.914661 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABitzLUccvPVi2pB58jWe4zbKzEH36lEkhaDRyyFHsw072Z-M5CvfcZT-sAsFpamysxmhebXdMjYv1cdF0cdKc5ZBXilPbIea0OJIEYpdHm9xeGKIYOP7g5985XD-7gRJ-SVRcOULxM1S8D-uPXaRJmn9bBwIbEC-ys027ZRHpwW_3iqGk Jun 25 16:09:09.914661 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jun 25 16:09:09.914661 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jun 25 16:09:09.914661 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jun 25 16:09:09.914661 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jun 25 16:09:09.914661 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jun 25 16:09:09.914661 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jun 25 16:09:09.914661 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Id: 4e1e0c6b3e544d138a1c7911cf155076 Jun 25 16:09:09.914661 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-VolumesSnapshotTestJSON-520792287 Jun 25 16:09:09.914661 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Role: reader,member Jun 25 16:09:09.914661 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Jun 25 16:09:09.916016 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4e1e0c6b3e544d138a1c7911cf155076"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4e1e0c6b3e544d138a1c7911cf155076"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4e1e0c6b3e544d138a1c7911cf155076", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4e1e0c6b3e544d138a1c7911cf155076"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:09:09.916016 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-VolumesSnapshotTestJSON-520792287 Jun 25 16:09:09.916016 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 4e1e0c6b3e544d138a1c7911cf155076 Jun 25 16:09:09.916016 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-520792287 Jun 25 16:09:09.916016 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User: tempest-VolumesSnapshotTestJSON-520792287-project Jun 25 16:09:09.916016 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jun 25 16:09:09.916016 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jun 25 16:09:09.916016 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Id: bf0332a9562946169ff8a45bf5e6f6f3 Jun 25 16:09:09.916016 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-VolumesSnapshotTestJSON-520792287-project Jun 25 16:09:09.916016 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: method: > Jun 25 16:09:09.916016 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: exception: Instance 51391a15-1b93-4d73-9478-f803e617ca6a could not be found. Jun 25 16:09:09.916016 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: action_args: {'id': '51391a15-1b93-4d73-9478-f803e617ca6a'} Jun 25 16:09:09.916806 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:09:09.916806 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:09:09.916806 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:09:09.916806 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:09:09.916806 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:09:09.916806 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:09:09.916806 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:09:09.916806 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:09:09.916806 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:09:09.916806 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:09:09.916806 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51391a15-1b93-4d73-9478-f803e617ca6a could not be found. Jun 25 16:09:09.916806 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:09:09.916806 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:09:09.916806 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:09:09.916806 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:09:09.916806 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:09:09.916806 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:09:09.916806 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:09:09.916806 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:09:09.916806 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:09:09.917937 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:09:09.917937 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 16:09:09.917937 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 16:09:09.917937 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:09:09.917937 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:09:09.917937 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:09:09.917937 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:09:09.917937 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51391a15-1b93-4d73-9478-f803e617ca6a could not be found. Jun 25 16:09:09.917937 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:09:09.917937 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:09:09.917937 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:09:09.917937 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:09:09.917937 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:09:09.917937 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:09:09.917937 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:09:09.917937 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:09:09.917937 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51391a15-1b93-4d73-9478-f803e617ca6a could not be found. Jun 25 16:09:09.917937 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:09:09.918916 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-33c73009-271d-4ca8-b29d-41abde42df06 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Returning 404 to user: Instance 51391a15-1b93-4d73-9478-f803e617ca6a could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:09:09.918916 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-33c73009-271d-4ca8-b29d-41abde42df06 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a" status: 404 len: 111 microversion: 2.1 time: 0.033426 Jun 25 16:09:09.918916 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 176/348] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:09 2022] GET /compute/v2.1/servers/51391a15-1b93-4d73-9478-f803e617ca6a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 16:09:09.941689 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-7c3a18b0-0d16-4522-95c7-a28f31533bef tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:09.949276 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-7c3a18b0-0d16-4522-95c7-a28f31533bef tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d" status: 200 len: 1314 microversion: 2.1 time: 0.183649 Jun 25 16:09:09.949803 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 173/349] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:09 2022] GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:10.320897 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-74417380-b747-4871-8e0c-6ea669fe9bfb req-33679124-2e75-4708-96a3-36c22967ae08 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "679fe627-88a7-42af-99d9-aefdf5b03b3d", "name": "network-vif-plugged", "status": "completed", "tag": "d3721cff-9dc7-44e9-9f72-4de800e8d602"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:09:10.329130 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-74417380-b747-4871-8e0c-6ea669fe9bfb req-33679124-2e75-4708-96a3-36c22967ae08 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:10.329566 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-74417380-b747-4871-8e0c-6ea669fe9bfb req-33679124-2e75-4708-96a3-36c22967ae08 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:10.348110 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-74417380-b747-4871-8e0c-6ea669fe9bfb req-33679124-2e75-4708-96a3-36c22967ae08 service nova] Creating event network-vif-plugged:d3721cff-9dc7-44e9-9f72-4de800e8d602 for instance 679fe627-88a7-42af-99d9-aefdf5b03b3d on hv-cinder-84762 Jun 25 16:09:10.356707 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-74417380-b747-4871-8e0c-6ea669fe9bfb req-33679124-2e75-4708-96a3-36c22967ae08 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039790 Jun 25 16:09:10.357756 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 177/350] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:09:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:09:10.970925 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-1e9a315b-c30b-40b2-92f3-0526ac46284e tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:10.972768 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-1e9a315b-c30b-40b2-92f3-0526ac46284e tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 679fe627-88a7-42af-99d9-aefdf5b03b3d] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:10.979824 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1e9a315b-c30b-40b2-92f3-0526ac46284e tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:10.980284 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1e9a315b-c30b-40b2-92f3-0526ac46284e tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:10.981092 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1e9a315b-c30b-40b2-92f3-0526ac46284e tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:10.981527 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1e9a315b-c30b-40b2-92f3-0526ac46284e tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:11.000993 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:09:11.125380 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-1e9a315b-c30b-40b2-92f3-0526ac46284e tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:11.133393 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-1e9a315b-c30b-40b2-92f3-0526ac46284e tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d" status: 200 len: 1314 microversion: 2.1 time: 0.169153 Jun 25 16:09:11.133997 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 174/351] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:10 2022] GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:12.148443 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:09:12.149227 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=6 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:09:12.153583 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-87a8992f-3a80-4384-b01f-d0abb0916c85 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:12.154296 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-87a8992f-3a80-4384-b01f-d0abb0916c85 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 679fe627-88a7-42af-99d9-aefdf5b03b3d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:12.162215 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-87a8992f-3a80-4384-b01f-d0abb0916c85 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:12.162653 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-87a8992f-3a80-4384-b01f-d0abb0916c85 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:12.163407 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-87a8992f-3a80-4384-b01f-d0abb0916c85 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:12.163830 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-87a8992f-3a80-4384-b01f-d0abb0916c85 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:12.302257 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-87a8992f-3a80-4384-b01f-d0abb0916c85 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:12.310371 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-87a8992f-3a80-4384-b01f-d0abb0916c85 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d" status: 200 len: 1314 microversion: 2.1 time: 0.163324 Jun 25 16:09:12.310934 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 178/352] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:12 2022] GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:13.327067 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-6a4fab46-8446-46be-8be8-1d752ec11764 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:13.328510 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-6a4fab46-8446-46be-8be8-1d752ec11764 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 679fe627-88a7-42af-99d9-aefdf5b03b3d] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:13.330511 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell0:SELECT=2 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:09:13.339983 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6a4fab46-8446-46be-8be8-1d752ec11764 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:13.339983 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6a4fab46-8446-46be-8be8-1d752ec11764 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:13.339983 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6a4fab46-8446-46be-8be8-1d752ec11764 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:13.339983 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6a4fab46-8446-46be-8be8-1d752ec11764 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:13.509763 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-6a4fab46-8446-46be-8be8-1d752ec11764 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:13.517873 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-6a4fab46-8446-46be-8be8-1d752ec11764 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d" status: 200 len: 1314 microversion: 2.1 time: 0.194721 Jun 25 16:09:13.518445 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 175/353] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:13 2022] GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:14.535964 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-87276c40-3181-4f88-ba19-e1b56b7509cd tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:14.536634 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-87276c40-3181-4f88-ba19-e1b56b7509cd tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 679fe627-88a7-42af-99d9-aefdf5b03b3d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:14.543242 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-87276c40-3181-4f88-ba19-e1b56b7509cd tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:14.543691 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-87276c40-3181-4f88-ba19-e1b56b7509cd tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:14.544489 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-87276c40-3181-4f88-ba19-e1b56b7509cd tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:14.544926 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-87276c40-3181-4f88-ba19-e1b56b7509cd tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:14.683572 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-87276c40-3181-4f88-ba19-e1b56b7509cd tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:14.691642 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-87276c40-3181-4f88-ba19-e1b56b7509cd tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d" status: 200 len: 1314 microversion: 2.1 time: 0.160166 Jun 25 16:09:14.692216 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 179/354] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:14 2022] GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:15.708649 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-fb611a68-df59-40d9-b159-095aed9bb5ce tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:15.709204 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-fb611a68-df59-40d9-b159-095aed9bb5ce tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 679fe627-88a7-42af-99d9-aefdf5b03b3d] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:15.716265 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-fb611a68-df59-40d9-b159-095aed9bb5ce tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:15.716753 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-fb611a68-df59-40d9-b159-095aed9bb5ce tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:15.717509 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-fb611a68-df59-40d9-b159-095aed9bb5ce tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:15.717944 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-fb611a68-df59-40d9-b159-095aed9bb5ce tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:15.863681 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-fb611a68-df59-40d9-b159-095aed9bb5ce tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:15.872209 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-fb611a68-df59-40d9-b159-095aed9bb5ce tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d" status: 200 len: 1498 microversion: 2.1 time: 0.167492 Jun 25 16:09:15.873183 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 176/355] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:15 2022] GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d => generated 1498 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:17.815449 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a55d1bd0-1ad7-46b6-8d8c-6eea39d16c6b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-415935150", "imageRef": "84c164fa-276d-4693-b7a0-24fd3024b359", "flavorRef": "452", "networks": [{"uuid": "04d69e79-7a43-49f5-af68-8c7222d567d8"}]}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:09:17.852070 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-1db04c9d-2577-42f7-90f1-8bc2b110465d tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:17.852622 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-1db04c9d-2577-42f7-90f1-8bc2b110465d tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 679fe627-88a7-42af-99d9-aefdf5b03b3d] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:17.859051 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1db04c9d-2577-42f7-90f1-8bc2b110465d tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:17.859525 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1db04c9d-2577-42f7-90f1-8bc2b110465d tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:17.860266 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1db04c9d-2577-42f7-90f1-8bc2b110465d tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:17.860722 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1db04c9d-2577-42f7-90f1-8bc2b110465d tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:17.878087 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-a55d1bd0-1ad7-46b6-8d8c-6eea39d16c6b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] validate_networks() for [('04d69e79-7a43-49f5-af68-8c7222d567d8', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 16:09:17.895775 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-1db04c9d-2577-42f7-90f1-8bc2b110465d tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 679fe627-88a7-42af-99d9-aefdf5b03b3d] Going to try to terminate instance {{(pid=117794) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 16:09:17.981225 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-1db04c9d-2577-42f7-90f1-8bc2b110465d tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "DELETE /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d" status: 204 len: 0 microversion: 2.1 time: 0.127640 Jun 25 16:09:17.981844 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 177/356] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Jun 25 16:09:17 2022] DELETE /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 25 16:09:17.990567 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-16f69388-9988-454f-b321-a87bad1db142 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:17.991261 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-16f69388-9988-454f-b321-a87bad1db142 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 679fe627-88a7-42af-99d9-aefdf5b03b3d] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:17.997264 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-16f69388-9988-454f-b321-a87bad1db142 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:17.997904 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-16f69388-9988-454f-b321-a87bad1db142 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:17.998668 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-16f69388-9988-454f-b321-a87bad1db142 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:17.999101 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-16f69388-9988-454f-b321-a87bad1db142 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:18.223769 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-16f69388-9988-454f-b321-a87bad1db142 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:18.232170 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-16f69388-9988-454f-b321-a87bad1db142 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d" status: 200 len: 1504 microversion: 2.1 time: 0.245723 Jun 25 16:09:18.232810 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 178/357] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:17 2022] GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d => generated 1504 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:09:18.311289 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-a55d1bd0-1ad7-46b6-8d8c-6eea39d16c6b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 16:09:18.311711 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-a55d1bd0-1ad7-46b6-8d8c-6eea39d16c6b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 16:09:18.312177 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-a55d1bd0-1ad7-46b6-8d8c-6eea39d16c6b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 16:09:18.312632 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-a55d1bd0-1ad7-46b6-8d8c-6eea39d16c6b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 16:09:18.313072 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-a55d1bd0-1ad7-46b6-8d8c-6eea39d16c6b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 16:09:18.322883 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a55d1bd0-1ad7-46b6-8d8c-6eea39d16c6b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:18.323327 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a55d1bd0-1ad7-46b6-8d8c-6eea39d16c6b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:18.324154 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a55d1bd0-1ad7-46b6-8d8c-6eea39d16c6b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:18.324617 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a55d1bd0-1ad7-46b6-8d8c-6eea39d16c6b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:18.341136 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-a55d1bd0-1ad7-46b6-8d8c-6eea39d16c6b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Getting quotas for project 4e1e0c6b3e544d138a1c7911cf155076. Resources: {'ram', 'cores', 'instances'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:09:18.345170 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-a55d1bd0-1ad7-46b6-8d8c-6eea39d16c6b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Getting quotas for user bf0332a9562946169ff8a45bf5e6f6f3 and project 4e1e0c6b3e544d138a1c7911cf155076. Resources: {'ram', 'cores', 'instances'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:09:18.356387 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a55d1bd0-1ad7-46b6-8d8c-6eea39d16c6b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 16:09:18.358665 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a55d1bd0-1ad7-46b6-8d8c-6eea39d16c6b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 41fc3e49-00d7-473e-8aff-17796e05c84b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84c164fa-276d-4693-b7a0-24fd3024b359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 16:09:18.402700 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a55d1bd0-1ad7-46b6-8d8c-6eea39d16c6b tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.591205 Jun 25 16:09:18.403337 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 180/358] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Jun 25 16:09:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 16:09:18.415946 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-47410edc-fa5b-4a6a-a27c-8f4081161f84 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:18.416690 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-47410edc-fa5b-4a6a-a27c-8f4081161f84 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 41fc3e49-00d7-473e-8aff-17796e05c84b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:18.471699 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-47410edc-fa5b-4a6a-a27c-8f4081161f84 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:18.478752 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-47410edc-fa5b-4a6a-a27c-8f4081161f84 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b" status: 200 len: 1218 microversion: 2.1 time: 0.066915 Jun 25 16:09:18.479312 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 179/359] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:18 2022] GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:09:19.254884 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-019b17cb-089e-4f29-b75f-61ac68f988c8 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:19.255474 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-019b17cb-089e-4f29-b75f-61ac68f988c8 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 679fe627-88a7-42af-99d9-aefdf5b03b3d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:19.262933 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-019b17cb-089e-4f29-b75f-61ac68f988c8 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:19.263378 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-019b17cb-089e-4f29-b75f-61ac68f988c8 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:19.264128 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-019b17cb-089e-4f29-b75f-61ac68f988c8 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:19.264593 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-019b17cb-089e-4f29-b75f-61ac68f988c8 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:19.405576 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-019b17cb-089e-4f29-b75f-61ac68f988c8 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:19.414150 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-019b17cb-089e-4f29-b75f-61ac68f988c8 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d" status: 200 len: 1504 microversion: 2.1 time: 0.165808 Jun 25 16:09:19.415185 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 181/360] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:19 2022] GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:19.498017 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-6c604f14-4d2c-4464-a4d0-c4cf58010cfe tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:19.498604 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-6c604f14-4d2c-4464-a4d0-c4cf58010cfe tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 41fc3e49-00d7-473e-8aff-17796e05c84b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:19.508931 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6c604f14-4d2c-4464-a4d0-c4cf58010cfe tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:19.509477 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6c604f14-4d2c-4464-a4d0-c4cf58010cfe tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:19.510551 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6c604f14-4d2c-4464-a4d0-c4cf58010cfe tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:19.511169 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6c604f14-4d2c-4464-a4d0-c4cf58010cfe tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:19.574546 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-6c604f14-4d2c-4464-a4d0-c4cf58010cfe tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:19.582791 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-6c604f14-4d2c-4464-a4d0-c4cf58010cfe tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b" status: 200 len: 1214 microversion: 2.1 time: 0.090550 Jun 25 16:09:19.588464 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 180/361] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:19 2022] GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b => generated 1214 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:20.432720 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4a7e6bb5-2588-4b6e-be7f-3181d14c0ffc tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:20.433418 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4a7e6bb5-2588-4b6e-be7f-3181d14c0ffc tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 679fe627-88a7-42af-99d9-aefdf5b03b3d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:20.440798 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4a7e6bb5-2588-4b6e-be7f-3181d14c0ffc tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:20.441254 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4a7e6bb5-2588-4b6e-be7f-3181d14c0ffc tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:20.442450 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4a7e6bb5-2588-4b6e-be7f-3181d14c0ffc tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:20.443082 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4a7e6bb5-2588-4b6e-be7f-3181d14c0ffc tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:20.602657 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-19856cad-c627-4bd4-b886-d41242113070 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:20.604321 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-19856cad-c627-4bd4-b886-d41242113070 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 41fc3e49-00d7-473e-8aff-17796e05c84b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:20.621513 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-19856cad-c627-4bd4-b886-d41242113070 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:20.622410 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-19856cad-c627-4bd4-b886-d41242113070 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:20.623508 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-19856cad-c627-4bd4-b886-d41242113070 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:20.624038 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-19856cad-c627-4bd4-b886-d41242113070 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:20.659261 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4a7e6bb5-2588-4b6e-be7f-3181d14c0ffc tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bbf2525354424683bfa550eadc0a748c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'be35accfa19641058c6452311878f2d4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:20.669393 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4a7e6bb5-2588-4b6e-be7f-3181d14c0ffc tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d" status: 200 len: 1504 microversion: 2.1 time: 0.240896 Jun 25 16:09:20.672777 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 182/362] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:20 2022] GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d => generated 1504 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:20.714673 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-19856cad-c627-4bd4-b886-d41242113070 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:20.725442 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-19856cad-c627-4bd4-b886-d41242113070 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b" status: 200 len: 1276 microversion: 2.1 time: 0.130075 Jun 25 16:09:20.726022 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 181/363] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:20 2022] GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b => generated 1276 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:09:20.814123 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-6339afa4-ad06-4017-b3f0-03a35d168cc2 req-98185db2-73d0-4d42-9588-7257f4f0645f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "679fe627-88a7-42af-99d9-aefdf5b03b3d", "name": "network-vif-deleted", "tag": "d3721cff-9dc7-44e9-9f72-4de800e8d602"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:09:20.822701 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-6339afa4-ad06-4017-b3f0-03a35d168cc2 req-98185db2-73d0-4d42-9588-7257f4f0645f service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:20.823128 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-6339afa4-ad06-4017-b3f0-03a35d168cc2 req-98185db2-73d0-4d42-9588-7257f4f0645f service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:20.834969 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-6339afa4-ad06-4017-b3f0-03a35d168cc2 req-98185db2-73d0-4d42-9588-7257f4f0645f service nova] Creating event network-vif-deleted:d3721cff-9dc7-44e9-9f72-4de800e8d602 for instance 679fe627-88a7-42af-99d9-aefdf5b03b3d on hv-cinder-84762 Jun 25 16:09:20.840820 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-6339afa4-ad06-4017-b3f0-03a35d168cc2 req-98185db2-73d0-4d42-9588-7257f4f0645f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030050 Jun 25 16:09:20.844266 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 183/364] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:09:21.689502 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-169af57c-a10b-4f3f-b079-4de5443ec960 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:21.690055 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-169af57c-a10b-4f3f-b079-4de5443ec960 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] [instance: 679fe627-88a7-42af-99d9-aefdf5b03b3d] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:21.696777 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-169af57c-a10b-4f3f-b079-4de5443ec960 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:21.697233 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-169af57c-a10b-4f3f-b079-4de5443ec960 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:21.698012 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-169af57c-a10b-4f3f-b079-4de5443ec960 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:21.698454 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-169af57c-a10b-4f3f-b079-4de5443ec960 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:21.713175 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.wsgi [None req-169af57c-a10b-4f3f-b079-4de5443ec960 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] HTTP exception thrown: Instance 679fe627-88a7-42af-99d9-aefdf5b03b3d could not be found. Jun 25 16:09:21.714876 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-169af57c-a10b-4f3f-b079-4de5443ec960 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Request method failure captured: Jun 25 16:09:21.714876 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: request: GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d HTTP/1.1 Jun 25 16:09:21.714876 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept: application/json Jun 25 16:09:21.714876 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept-Encoding: identity Jun 25 16:09:21.714876 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Connection: close Jun 25 16:09:21.714876 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Length: 0 Jun 25 16:09:21.714876 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Type: application/json Jun 25 16:09:21.714876 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Host: 10.222.0.13 Jun 25 16:09:21.714876 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Openstack-System-Scope: None Jun 25 16:09:21.714876 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: User-Agent: python-urllib3/1.26.9 Jun 25 16:09:21.714876 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Auth-Token: gAAAAABitzL-x5nog9BNVqbX0j4E4WJZgkLecoU5pbkSx1AexwzVTGl9Rp4aqJ03CVnzTDaY6l7fE130415xC29bhxAg4RBFWk_V693aSP1aJtukp9oqvmTpKx5eG_WzVN0bCPg_BI5VMCnFMJYJJMUYUweq2t_gJ-pzRMBt24We2kI_RtYXQAI Jun 25 16:09:21.714876 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Id: None Jun 25 16:09:21.714876 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Name: None Jun 25 16:09:21.714876 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Identity-Status: Confirmed Jun 25 16:09:21.714876 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Is-Admin-Project: True Jun 25 16:09:21.714876 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Id: default Jun 25 16:09:21.714876 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Name: Default Jun 25 16:09:21.714876 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Id: be35accfa19641058c6452311878f2d4 Jun 25 16:09:21.714876 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Name: tempest-VolumesActionsTest-999016632 Jun 25 16:09:21.714876 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Role: reader,member Jun 25 16:09:21.714876 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Roles: reader,member Jun 25 16:09:21.716371 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/be35accfa19641058c6452311878f2d4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/be35accfa19641058c6452311878f2d4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_be35accfa19641058c6452311878f2d4", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/be35accfa19641058c6452311878f2d4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:09:21.716371 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant: tempest-VolumesActionsTest-999016632 Jun 25 16:09:21.716371 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Id: be35accfa19641058c6452311878f2d4 Jun 25 16:09:21.716371 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Name: tempest-VolumesActionsTest-999016632 Jun 25 16:09:21.716371 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User: tempest-VolumesActionsTest-999016632-project Jun 25 16:09:21.716371 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Id: default Jun 25 16:09:21.716371 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Name: Default Jun 25 16:09:21.716371 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Id: bbf2525354424683bfa550eadc0a748c Jun 25 16:09:21.716371 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Name: tempest-VolumesActionsTest-999016632-project Jun 25 16:09:21.716371 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: method: > Jun 25 16:09:21.716371 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: exception: Instance 679fe627-88a7-42af-99d9-aefdf5b03b3d could not be found. Jun 25 16:09:21.716371 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: action_args: {'id': '679fe627-88a7-42af-99d9-aefdf5b03b3d'} Jun 25 16:09:21.717258 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:09:21.717258 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:09:21.717258 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:09:21.717258 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:09:21.717258 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:09:21.717258 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:09:21.717258 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:09:21.717258 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:09:21.717258 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:09:21.717258 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:09:21.717258 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 679fe627-88a7-42af-99d9-aefdf5b03b3d could not be found. Jun 25 16:09:21.717258 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:09:21.717258 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:09:21.717258 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:09:21.717258 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:09:21.717258 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:09:21.717258 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:09:21.717258 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:09:21.717258 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:09:21.717258 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:09:21.718646 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:09:21.718646 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 16:09:21.718646 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 16:09:21.718646 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:09:21.718646 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:09:21.718646 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:09:21.718646 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:09:21.718646 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 679fe627-88a7-42af-99d9-aefdf5b03b3d could not be found. Jun 25 16:09:21.718646 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:09:21.718646 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:09:21.718646 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:09:21.718646 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:09:21.718646 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:09:21.718646 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:09:21.718646 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:09:21.718646 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:09:21.718646 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 679fe627-88a7-42af-99d9-aefdf5b03b3d could not be found. Jun 25 16:09:21.718646 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:09:21.719748 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-169af57c-a10b-4f3f-b079-4de5443ec960 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] Returning 404 to user: Instance 679fe627-88a7-42af-99d9-aefdf5b03b3d could not be found. {{(pid=117794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:09:21.719748 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-169af57c-a10b-4f3f-b079-4de5443ec960 tempest-VolumesActionsTest-999016632 tempest-VolumesActionsTest-999016632-project] 10.222.0.13 "GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d" status: 404 len: 111 microversion: 2.1 time: 0.032963 Jun 25 16:09:21.719748 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 182/365] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:21 2022] GET /compute/v2.1/servers/679fe627-88a7-42af-99d9-aefdf5b03b3d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:09:21.743923 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-daf8511e-0559-48be-b6d1-19d6d336698e tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:21.744940 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-daf8511e-0559-48be-b6d1-19d6d336698e tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 41fc3e49-00d7-473e-8aff-17796e05c84b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:21.751866 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-daf8511e-0559-48be-b6d1-19d6d336698e tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:21.752552 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-daf8511e-0559-48be-b6d1-19d6d336698e tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:21.753444 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-daf8511e-0559-48be-b6d1-19d6d336698e tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:21.753969 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-daf8511e-0559-48be-b6d1-19d6d336698e tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:21.896646 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-daf8511e-0559-48be-b6d1-19d6d336698e tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:21.904672 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-daf8511e-0559-48be-b6d1-19d6d336698e tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b" status: 200 len: 1318 microversion: 2.1 time: 0.165340 Jun 25 16:09:21.908861 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 184/366] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:21 2022] GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:21.917517 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-9ff02e83-4117-49b2-beb1-977ce2cfed05 req-e9914d14-44a0-4a15-987b-ecff7ec99392 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41fc3e49-00d7-473e-8aff-17796e05c84b", "tag": "43551aa5-c58d-4fa4-ab62-60938bf7595a"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:09:21.931727 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-9ff02e83-4117-49b2-beb1-977ce2cfed05 req-e9914d14-44a0-4a15-987b-ecff7ec99392 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:21.932374 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-9ff02e83-4117-49b2-beb1-977ce2cfed05 req-e9914d14-44a0-4a15-987b-ecff7ec99392 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:21.950122 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-9ff02e83-4117-49b2-beb1-977ce2cfed05 req-e9914d14-44a0-4a15-987b-ecff7ec99392 service nova] Creating event network-changed:43551aa5-c58d-4fa4-ab62-60938bf7595a for instance 41fc3e49-00d7-473e-8aff-17796e05c84b on hv-cinder-84762 Jun 25 16:09:21.958560 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-9ff02e83-4117-49b2-beb1-977ce2cfed05 req-e9914d14-44a0-4a15-987b-ecff7ec99392 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044788 Jun 25 16:09:21.959163 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 183/367] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:09:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:09:21.999063 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-54cdf32c-00c3-4bd7-a66b-58849ae69a72 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:21.999524 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-54cdf32c-00c3-4bd7-a66b-58849ae69a72 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:22.009924 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-54cdf32c-00c3-4bd7-a66b-58849ae69a72 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:22.010380 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-54cdf32c-00c3-4bd7-a66b-58849ae69a72 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:22.011224 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-54cdf32c-00c3-4bd7-a66b-58849ae69a72 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:22.012298 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-54cdf32c-00c3-4bd7-a66b-58849ae69a72 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:22.041685 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-54cdf32c-00c3-4bd7-a66b-58849ae69a72 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec/ips" status: 200 len: 152 microversion: 2.20 time: 0.046535 Jun 25 16:09:22.048370 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 185/368] 10.222.0.13 () {60 vars in 1288 bytes} [Sat Jun 25 16:09:21 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec/ips => generated 152 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 16:09:22.927424 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-ab36ea43-c5dd-4195-ac1a-d9855515d1e4 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:22.928611 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-ab36ea43-c5dd-4195-ac1a-d9855515d1e4 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 41fc3e49-00d7-473e-8aff-17796e05c84b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:22.939978 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ab36ea43-c5dd-4195-ac1a-d9855515d1e4 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:22.940931 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ab36ea43-c5dd-4195-ac1a-d9855515d1e4 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:22.941709 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ab36ea43-c5dd-4195-ac1a-d9855515d1e4 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:22.942144 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ab36ea43-c5dd-4195-ac1a-d9855515d1e4 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:23.091580 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-ab36ea43-c5dd-4195-ac1a-d9855515d1e4 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:23.101107 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-ab36ea43-c5dd-4195-ac1a-d9855515d1e4 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b" status: 200 len: 1318 microversion: 2.1 time: 0.181625 Jun 25 16:09:23.101663 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 184/369] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:22 2022] GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b => generated 1318 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:23.953230 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a18028dd-469d-4c8b-8d6b-4a7f8361c87d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:09:23.953961 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a18028dd-469d-4c8b-8d6b-4a7f8361c87d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:23.962068 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a18028dd-469d-4c8b-8d6b-4a7f8361c87d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:23.962515 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a18028dd-469d-4c8b-8d6b-4a7f8361c87d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:23.963303 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a18028dd-469d-4c8b-8d6b-4a7f8361c87d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:23.963735 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a18028dd-469d-4c8b-8d6b-4a7f8361c87d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:23.986315 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-a18028dd-469d-4c8b-8d6b-4a7f8361c87d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lazy-loading 'flavor' on Instance uuid e6ae5a58-db83-401e-a158-ebf0981e84ec {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 16:09:24.117411 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-dbed6797-7371-4968-87bd-369eeb7b9483 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:24.117942 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-dbed6797-7371-4968-87bd-369eeb7b9483 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 41fc3e49-00d7-473e-8aff-17796e05c84b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:24.124929 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-dbed6797-7371-4968-87bd-369eeb7b9483 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:24.125361 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-dbed6797-7371-4968-87bd-369eeb7b9483 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:24.126125 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-dbed6797-7371-4968-87bd-369eeb7b9483 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:24.126554 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-dbed6797-7371-4968-87bd-369eeb7b9483 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:24.259750 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-dbed6797-7371-4968-87bd-369eeb7b9483 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:24.267645 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-dbed6797-7371-4968-87bd-369eeb7b9483 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b" status: 200 len: 1318 microversion: 2.1 time: 0.154124 Jun 25 16:09:24.268305 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 185/370] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:24 2022] GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:09:24.309954 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a18028dd-469d-4c8b-8d6b-4a7f8361c87d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "POST /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec/action" status: 202 len: 0 microversion: 2.20 time: 0.362298 Jun 25 16:09:24.310570 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 186/371] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Jun 25 16:09:23 2022] POST /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 25 16:09:24.319067 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-58f791eb-ee49-4bd4-9653-a3a3e620346b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:24.319674 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-58f791eb-ee49-4bd4-9653-a3a3e620346b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:24.325967 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-58f791eb-ee49-4bd4-9653-a3a3e620346b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:24.326418 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-58f791eb-ee49-4bd4-9653-a3a3e620346b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:24.327182 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-58f791eb-ee49-4bd4-9653-a3a3e620346b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:24.327621 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-58f791eb-ee49-4bd4-9653-a3a3e620346b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:24.468116 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-58f791eb-ee49-4bd4-9653-a3a3e620346b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:24.476554 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-58f791eb-ee49-4bd4-9653-a3a3e620346b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:24.478047 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-58f791eb-ee49-4bd4-9653-a3a3e620346b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:24.479199 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-58f791eb-ee49-4bd4-9653-a3a3e620346b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1723 microversion: 2.20 time: 0.164200 Jun 25 16:09:24.479754 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 186/372] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:09:24 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:09:25.289209 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ea6fe599-d28b-45e8-ab6f-f5ccd75079cc tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:25.289961 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ea6fe599-d28b-45e8-ab6f-f5ccd75079cc tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 41fc3e49-00d7-473e-8aff-17796e05c84b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:25.297085 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ea6fe599-d28b-45e8-ab6f-f5ccd75079cc tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:25.297549 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ea6fe599-d28b-45e8-ab6f-f5ccd75079cc tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:25.298352 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ea6fe599-d28b-45e8-ab6f-f5ccd75079cc tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:25.298831 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ea6fe599-d28b-45e8-ab6f-f5ccd75079cc tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:25.435884 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ea6fe599-d28b-45e8-ab6f-f5ccd75079cc tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:25.444445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ea6fe599-d28b-45e8-ab6f-f5ccd75079cc tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b" status: 200 len: 1318 microversion: 2.1 time: 0.161274 Jun 25 16:09:25.445372 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 187/373] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:25 2022] GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:25.501326 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-429bfbac-65e1-4ddb-806b-139fb3ebb593 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:25.502279 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-429bfbac-65e1-4ddb-806b-139fb3ebb593 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:25.513660 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-429bfbac-65e1-4ddb-806b-139fb3ebb593 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:25.514414 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-429bfbac-65e1-4ddb-806b-139fb3ebb593 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:25.516034 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-429bfbac-65e1-4ddb-806b-139fb3ebb593 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:25.516825 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-429bfbac-65e1-4ddb-806b-139fb3ebb593 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:25.649538 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-429bfbac-65e1-4ddb-806b-139fb3ebb593 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:25.657961 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-429bfbac-65e1-4ddb-806b-139fb3ebb593 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:25.659550 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-429bfbac-65e1-4ddb-806b-139fb3ebb593 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:25.661648 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-429bfbac-65e1-4ddb-806b-139fb3ebb593 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1723 microversion: 2.20 time: 0.166602 Jun 25 16:09:25.662841 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 187/374] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:09:25 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:09:26.243720 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a15f5144-4be7-4c41-85ba-af71789f1703 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:26.244564 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a15f5144-4be7-4c41-85ba-af71789f1703 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 0d92f23b-4b14-4619-a2c9-a90bd96b27fd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:26.255268 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a15f5144-4be7-4c41-85ba-af71789f1703 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:26.256005 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a15f5144-4be7-4c41-85ba-af71789f1703 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:26.257346 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a15f5144-4be7-4c41-85ba-af71789f1703 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:26.258060 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a15f5144-4be7-4c41-85ba-af71789f1703 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:26.285568 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a15f5144-4be7-4c41-85ba-af71789f1703 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd/ips" status: 200 len: 151 microversion: 2.1 time: 0.048821 Jun 25 16:09:26.286114 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 188/375] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Jun 25 16:09:26 2022] GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd/ips => generated 151 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:09:26.298539 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-13506caf-1462-4bb2-899f-23ea0c22845a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f1a2fa49-1d71-4c4e-80d4-0e3478ac3503"}} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:09:26.299604 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-13506caf-1462-4bb2-899f-23ea0c22845a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 0d92f23b-4b14-4619-a2c9-a90bd96b27fd] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:26.306151 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-13506caf-1462-4bb2-899f-23ea0c22845a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:26.306599 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-13506caf-1462-4bb2-899f-23ea0c22845a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:26.307351 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-13506caf-1462-4bb2-899f-23ea0c22845a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:26.307785 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-13506caf-1462-4bb2-899f-23ea0c22845a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:26.393801 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.wsgi [None req-13506caf-1462-4bb2-899f-23ea0c22845a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] HTTP exception thrown: Invalid volume: volume f1a2fa49-1d71-4c4e-80d4-0e3478ac3503 is already attached to instances: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f Jun 25 16:09:26.396018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-13506caf-1462-4bb2-899f-23ea0c22845a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Request method failure captured: Jun 25 16:09:26.396018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: request: POST /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd/os-volume_attachments HTTP/1.1 Jun 25 16:09:26.396018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept: application/json Jun 25 16:09:26.396018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept-Encoding: identity Jun 25 16:09:26.396018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Connection: close Jun 25 16:09:26.396018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Length: 74 Jun 25 16:09:26.396018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Type: application/json Jun 25 16:09:26.396018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Host: 10.222.0.13 Jun 25 16:09:26.396018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Openstack-System-Scope: None Jun 25 16:09:26.396018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: User-Agent: python-urllib3/1.26.9 Jun 25 16:09:26.396018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Auth-Token: gAAAAABitzJ4VTX9FBO09dP9eDUNJ7kXDvOeQ_3800jobL_5yAtOgxQI54WUI0jlTKIeeP5rTVj0MTWBlkUxqhr419kWtC1O7I2ACk-hIdi2fMzwDg3khIX53lL7PAAWZJjGvTHF0eyDgeSSmpMCdU8rbC_7cLecxR6vp9KZlm3nwM3ZTo0XAYY Jun 25 16:09:26.396018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Id: None Jun 25 16:09:26.396018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Name: None Jun 25 16:09:26.396018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Identity-Status: Confirmed Jun 25 16:09:26.396018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Is-Admin-Project: True Jun 25 16:09:26.396018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Id: default Jun 25 16:09:26.396018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Name: Default Jun 25 16:09:26.396018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Id: b1bba8f74dbd433bbffdb2ffbfc481fb Jun 25 16:09:26.396018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Name: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:09:26.396018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Role: reader,member Jun 25 16:09:26.396018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Roles: reader,member Jun 25 16:09:26.397381 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b1bba8f74dbd433bbffdb2ffbfc481fb", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:09:26.397381 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:09:26.397381 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Id: b1bba8f74dbd433bbffdb2ffbfc481fb Jun 25 16:09:26.397381 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:09:26.397381 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User: tempest-AttachVolumeNegativeTest-1137598465-project Jun 25 16:09:26.397381 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Id: default Jun 25 16:09:26.397381 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Name: Default Jun 25 16:09:26.397381 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Id: 19140330ae664e45b85f47f321496191 Jun 25 16:09:26.397381 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Name: tempest-AttachVolumeNegativeTest-1137598465-project Jun 25 16:09:26.397381 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Jun 25 16:09:26.397381 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: {"volumeAttachment": {"volumeId": "f1a2fa49-1d71-4c4e-80d4-0e3478ac3503"}} Jun 25 16:09:26.397381 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: method: > Jun 25 16:09:26.398128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: exception: Invalid volume: volume f1a2fa49-1d71-4c4e-80d4-0e3478ac3503 is already attached to instances: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f Jun 25 16:09:26.398128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: action_args: {'server_id': '0d92f23b-4b14-4619-a2c9-a90bd96b27fd', 'body': {'volumeAttachment': {'volumeId': 'f1a2fa49-1d71-4c4e-80d4-0e3478ac3503'}}} Jun 25 16:09:26.398128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:09:26.398128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:09:26.398128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 25 16:09:26.398128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 25 16:09:26.398128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 25 16:09:26.398128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 16:09:26.398128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 25 16:09:26.398128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 25 16:09:26.398128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 25 16:09:26.398128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 25 16:09:26.398128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 25 16:09:26.398128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 25 16:09:26.398128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f1a2fa49-1d71-4c4e-80d4-0e3478ac3503 is already attached to instances: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f Jun 25 16:09:26.398128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:09:26.398128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:09:26.398128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:09:26.398128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:09:26.401664 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:09:26.401664 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:09:26.401664 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:09:26.401664 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:09:26.401664 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:09:26.401664 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:09:26.401664 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 16:09:26.401664 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 16:09:26.401664 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 16:09:26.401664 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 16:09:26.401664 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 16:09:26.401664 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 16:09:26.401664 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 25 16:09:26.401664 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 25 16:09:26.401664 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f1a2fa49-1d71-4c4e-80d4-0e3478ac3503 is already attached to instances: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f Jun 25 16:09:26.401664 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:09:26.401664 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:09:26.401664 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:09:26.401664 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:09:26.401664 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:09:26.404174 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:09:26.404174 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:09:26.404174 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:09:26.404174 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f1a2fa49-1d71-4c4e-80d4-0e3478ac3503 is already attached to instances: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f Jun 25 16:09:26.404174 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:09:26.404174 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-13506caf-1462-4bb2-899f-23ea0c22845a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Returning 400 to user: Invalid volume: volume f1a2fa49-1d71-4c4e-80d4-0e3478ac3503 is already attached to instances: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f {{(pid=117794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:09:26.404174 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-13506caf-1462-4bb2-899f-23ea0c22845a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "POST /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103110 Jun 25 16:09:26.404174 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 188/376] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Jun 25 16:09:26 2022] POST /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 16:09:26.406955 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7beb8ad4-68d5-498f-a243-9b6ea6f9f409 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:26.407478 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7beb8ad4-68d5-498f-a243-9b6ea6f9f409 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 0d92f23b-4b14-4619-a2c9-a90bd96b27fd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:26.414378 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7beb8ad4-68d5-498f-a243-9b6ea6f9f409 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:26.414963 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7beb8ad4-68d5-498f-a243-9b6ea6f9f409 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:26.415752 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7beb8ad4-68d5-498f-a243-9b6ea6f9f409 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:26.416188 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7beb8ad4-68d5-498f-a243-9b6ea6f9f409 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:26.441446 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7beb8ad4-68d5-498f-a243-9b6ea6f9f409 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 0d92f23b-4b14-4619-a2c9-a90bd96b27fd] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 16:09:26.462281 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-91528707-0430-41a4-9867-af65dbb4aebd tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:26.462891 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-91528707-0430-41a4-9867-af65dbb4aebd tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 41fc3e49-00d7-473e-8aff-17796e05c84b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:26.469949 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-91528707-0430-41a4-9867-af65dbb4aebd tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:26.470403 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-91528707-0430-41a4-9867-af65dbb4aebd tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:26.471174 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-91528707-0430-41a4-9867-af65dbb4aebd tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:26.471623 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-91528707-0430-41a4-9867-af65dbb4aebd tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:26.520110 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7beb8ad4-68d5-498f-a243-9b6ea6f9f409 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd" status: 204 len: 0 microversion: 2.1 time: 0.116774 Jun 25 16:09:26.523621 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 189/377] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Jun 25 16:09:26 2022] DELETE /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 16:09:26.529952 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-bc31db29-cef0-4a1b-9189-b53c7a14f662 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:26.531032 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-bc31db29-cef0-4a1b-9189-b53c7a14f662 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 0d92f23b-4b14-4619-a2c9-a90bd96b27fd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:26.541807 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bc31db29-cef0-4a1b-9189-b53c7a14f662 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:26.542328 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bc31db29-cef0-4a1b-9189-b53c7a14f662 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:26.543148 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bc31db29-cef0-4a1b-9189-b53c7a14f662 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:26.543733 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bc31db29-cef0-4a1b-9189-b53c7a14f662 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:26.651160 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-91528707-0430-41a4-9867-af65dbb4aebd tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:26.658888 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-91528707-0430-41a4-9867-af65dbb4aebd tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b" status: 200 len: 1318 microversion: 2.1 time: 0.200423 Jun 25 16:09:26.659486 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 189/378] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:26 2022] GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:26.680686 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-17296411-611c-43f5-a141-7c978cf50d9c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:26.681320 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-17296411-611c-43f5-a141-7c978cf50d9c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:26.687841 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-17296411-611c-43f5-a141-7c978cf50d9c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:26.688267 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-17296411-611c-43f5-a141-7c978cf50d9c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:26.689058 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-17296411-611c-43f5-a141-7c978cf50d9c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:26.689521 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-17296411-611c-43f5-a141-7c978cf50d9c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:26.698496 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-bc31db29-cef0-4a1b-9189-b53c7a14f662 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:26.706371 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-bc31db29-cef0-4a1b-9189-b53c7a14f662 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd" status: 200 len: 1682 microversion: 2.1 time: 0.180912 Jun 25 16:09:26.707037 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 190/379] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:26 2022] GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:09:26.827132 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-17296411-611c-43f5-a141-7c978cf50d9c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:26.836007 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-17296411-611c-43f5-a141-7c978cf50d9c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:26.837564 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-17296411-611c-43f5-a141-7c978cf50d9c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:26.838717 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-17296411-611c-43f5-a141-7c978cf50d9c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1723 microversion: 2.20 time: 0.162043 Jun 25 16:09:26.839251 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 190/380] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:09:26 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:09:27.675996 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a93361da-44ed-440d-9656-18e918a64bed tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:27.677483 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a93361da-44ed-440d-9656-18e918a64bed tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 41fc3e49-00d7-473e-8aff-17796e05c84b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:27.687550 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a93361da-44ed-440d-9656-18e918a64bed tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:27.688284 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a93361da-44ed-440d-9656-18e918a64bed tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:27.689361 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a93361da-44ed-440d-9656-18e918a64bed tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:27.690053 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a93361da-44ed-440d-9656-18e918a64bed tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:27.727143 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-dbefc797-7d8a-4e66-bda5-ffb4e167b10d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:27.728439 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-dbefc797-7d8a-4e66-bda5-ffb4e167b10d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 0d92f23b-4b14-4619-a2c9-a90bd96b27fd] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:27.735769 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-dbefc797-7d8a-4e66-bda5-ffb4e167b10d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:27.736498 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-dbefc797-7d8a-4e66-bda5-ffb4e167b10d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:27.737855 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-dbefc797-7d8a-4e66-bda5-ffb4e167b10d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:27.738621 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-dbefc797-7d8a-4e66-bda5-ffb4e167b10d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:27.983726 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a93361da-44ed-440d-9656-18e918a64bed tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:27.991635 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a93361da-44ed-440d-9656-18e918a64bed tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b" status: 200 len: 1318 microversion: 2.1 time: 0.319648 Jun 25 16:09:28.001427 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 191/381] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:27 2022] GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b => generated 1318 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:28.006646 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-67ea6133-16a3-4010-b060-d97aef0f1c3c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:28.007466 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-67ea6133-16a3-4010-b060-d97aef0f1c3c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:28.013990 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-67ea6133-16a3-4010-b060-d97aef0f1c3c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:28.014988 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-67ea6133-16a3-4010-b060-d97aef0f1c3c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:28.015921 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-67ea6133-16a3-4010-b060-d97aef0f1c3c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:28.016524 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-67ea6133-16a3-4010-b060-d97aef0f1c3c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:28.037245 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:09:28.089786 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-dbefc797-7d8a-4e66-bda5-ffb4e167b10d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:28.096578 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:09:28.099481 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-dbefc797-7d8a-4e66-bda5-ffb4e167b10d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd" status: 200 len: 1682 microversion: 2.1 time: 0.376182 Jun 25 16:09:28.122947 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 191/382] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:27 2022] GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd => generated 1682 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:09:28.209700 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-67ea6133-16a3-4010-b060-d97aef0f1c3c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:28.224897 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-67ea6133-16a3-4010-b060-d97aef0f1c3c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:28.226773 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-67ea6133-16a3-4010-b060-d97aef0f1c3c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:28.227953 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-67ea6133-16a3-4010-b060-d97aef0f1c3c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1723 microversion: 2.20 time: 0.225273 Jun 25 16:09:28.228588 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 192/383] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:09:28 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:09:29.008911 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-5765226a-6bc6-4a6a-97ab-234f22ee8946 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:29.010280 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-5765226a-6bc6-4a6a-97ab-234f22ee8946 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 41fc3e49-00d7-473e-8aff-17796e05c84b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:29.012849 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell0:SELECT=2 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:09:29.021237 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5765226a-6bc6-4a6a-97ab-234f22ee8946 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:29.022099 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5765226a-6bc6-4a6a-97ab-234f22ee8946 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:29.022984 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5765226a-6bc6-4a6a-97ab-234f22ee8946 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:29.023523 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5765226a-6bc6-4a6a-97ab-234f22ee8946 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:29.133146 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f1559177-75f6-4114-8968-4e0c7c02dc31 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:29.134601 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f1559177-75f6-4114-8968-4e0c7c02dc31 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 0d92f23b-4b14-4619-a2c9-a90bd96b27fd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:29.138423 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:09:29.139982 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=6 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:09:29.147724 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f1559177-75f6-4114-8968-4e0c7c02dc31 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:29.148532 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f1559177-75f6-4114-8968-4e0c7c02dc31 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:29.149477 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f1559177-75f6-4114-8968-4e0c7c02dc31 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:29.149912 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f1559177-75f6-4114-8968-4e0c7c02dc31 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:29.334279 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-5765226a-6bc6-4a6a-97ab-234f22ee8946 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:29.345726 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-5765226a-6bc6-4a6a-97ab-234f22ee8946 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b" status: 200 len: 1318 microversion: 2.1 time: 0.340139 Jun 25 16:09:29.348392 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 192/384] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:29 2022] GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b => generated 1318 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:09:29.354909 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-7a61f17d-b9b3-4c57-943e-da66e38c46c0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:29.356079 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-7a61f17d-b9b3-4c57-943e-da66e38c46c0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:29.366294 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7a61f17d-b9b3-4c57-943e-da66e38c46c0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:29.368028 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7a61f17d-b9b3-4c57-943e-da66e38c46c0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:29.369418 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7a61f17d-b9b3-4c57-943e-da66e38c46c0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:29.370433 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7a61f17d-b9b3-4c57-943e-da66e38c46c0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:29.518889 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f1559177-75f6-4114-8968-4e0c7c02dc31 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:29.531660 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f1559177-75f6-4114-8968-4e0c7c02dc31 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd" status: 200 len: 1682 microversion: 2.1 time: 0.404042 Jun 25 16:09:29.542554 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 193/385] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:29 2022] GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd => generated 1682 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:29.647875 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-7a61f17d-b9b3-4c57-943e-da66e38c46c0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:29.668983 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-7a61f17d-b9b3-4c57-943e-da66e38c46c0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:29.677798 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-7a61f17d-b9b3-4c57-943e-da66e38c46c0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:29.679442 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-7a61f17d-b9b3-4c57-943e-da66e38c46c0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1723 microversion: 2.20 time: 0.329756 Jun 25 16:09:29.680479 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 193/386] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:09:29 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1723 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:09:29.819883 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-7d38f758-c283-4cd4-9608-02c3044a0b9e req-8abea449-c870-4b0a-a0ca-6ec413de0a47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d92f23b-4b14-4619-a2c9-a90bd96b27fd", "name": "network-vif-deleted", "tag": "dc0159e7-f976-4ca8-a996-a731692f1e35"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:09:29.828595 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-7d38f758-c283-4cd4-9608-02c3044a0b9e req-8abea449-c870-4b0a-a0ca-6ec413de0a47 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:29.829215 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-7d38f758-c283-4cd4-9608-02c3044a0b9e req-8abea449-c870-4b0a-a0ca-6ec413de0a47 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:29.844592 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-7d38f758-c283-4cd4-9608-02c3044a0b9e req-8abea449-c870-4b0a-a0ca-6ec413de0a47 service nova] Creating event network-vif-deleted:dc0159e7-f976-4ca8-a996-a731692f1e35 for instance 0d92f23b-4b14-4619-a2c9-a90bd96b27fd on hv-cinder-84762 Jun 25 16:09:29.850206 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-7d38f758-c283-4cd4-9608-02c3044a0b9e req-8abea449-c870-4b0a-a0ca-6ec413de0a47 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033730 Jun 25 16:09:29.854581 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 194/387] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:09:30.363887 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-30afd15c-70e8-4607-86ce-e1c31c58ad1a tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:30.365251 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-30afd15c-70e8-4607-86ce-e1c31c58ad1a tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 41fc3e49-00d7-473e-8aff-17796e05c84b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:30.380584 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-30afd15c-70e8-4607-86ce-e1c31c58ad1a tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:30.384629 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-30afd15c-70e8-4607-86ce-e1c31c58ad1a tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:30.386296 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-30afd15c-70e8-4607-86ce-e1c31c58ad1a tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:30.387476 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-30afd15c-70e8-4607-86ce-e1c31c58ad1a tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:30.552863 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-370ad772-050a-42ad-9c35-8d22bba7e28f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:30.554773 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-370ad772-050a-42ad-9c35-8d22bba7e28f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 0d92f23b-4b14-4619-a2c9-a90bd96b27fd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:30.572901 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-370ad772-050a-42ad-9c35-8d22bba7e28f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:30.575331 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-370ad772-050a-42ad-9c35-8d22bba7e28f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:30.579179 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-370ad772-050a-42ad-9c35-8d22bba7e28f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:30.583276 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-370ad772-050a-42ad-9c35-8d22bba7e28f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:30.635384 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-30afd15c-70e8-4607-86ce-e1c31c58ad1a tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:30.645646 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-30afd15c-70e8-4607-86ce-e1c31c58ad1a tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b" status: 200 len: 1318 microversion: 2.1 time: 0.285467 Jun 25 16:09:30.649443 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 194/388] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:30 2022] GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:30.671626 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-370ad772-050a-42ad-9c35-8d22bba7e28f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:30.672328 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-370ad772-050a-42ad-9c35-8d22bba7e28f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:30.672971 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-370ad772-050a-42ad-9c35-8d22bba7e28f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lazy-loading 'fault' on Instance uuid 0d92f23b-4b14-4619-a2c9-a90bd96b27fd {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 16:09:30.704521 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-d4faf1f3-a3b6-4d97-aec0-fb1abfc5366d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:30.705607 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-d4faf1f3-a3b6-4d97-aec0-fb1abfc5366d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:30.726482 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d4faf1f3-a3b6-4d97-aec0-fb1abfc5366d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:30.726937 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d4faf1f3-a3b6-4d97-aec0-fb1abfc5366d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:30.727743 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d4faf1f3-a3b6-4d97-aec0-fb1abfc5366d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:30.728158 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d4faf1f3-a3b6-4d97-aec0-fb1abfc5366d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:30.756655 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-370ad772-050a-42ad-9c35-8d22bba7e28f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:30.768797 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-370ad772-050a-42ad-9c35-8d22bba7e28f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd" status: 200 len: 1331 microversion: 2.1 time: 0.219896 Jun 25 16:09:30.770025 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 195/389] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:30 2022] GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd => generated 1331 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:09:30.983571 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d4faf1f3-a3b6-4d97-aec0-fb1abfc5366d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:30.999172 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d4faf1f3-a3b6-4d97-aec0-fb1abfc5366d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:31.001575 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d4faf1f3-a3b6-4d97-aec0-fb1abfc5366d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:31.006241 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-d4faf1f3-a3b6-4d97-aec0-fb1abfc5366d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1723 microversion: 2.20 time: 0.307940 Jun 25 16:09:31.016163 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 195/390] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:09:30 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1723 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:09:31.184152 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-60080e40-8dce-4f80-b41b-6bc33f1cbb77 req-b3e06ed0-6580-4f7e-924a-9f0de4c46f2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41fc3e49-00d7-473e-8aff-17796e05c84b", "name": "network-vif-plugged", "status": "completed", "tag": "43551aa5-c58d-4fa4-ab62-60938bf7595a"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:09:31.202250 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-60080e40-8dce-4f80-b41b-6bc33f1cbb77 req-b3e06ed0-6580-4f7e-924a-9f0de4c46f2e service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:31.202976 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-60080e40-8dce-4f80-b41b-6bc33f1cbb77 req-b3e06ed0-6580-4f7e-924a-9f0de4c46f2e service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:31.219683 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-60080e40-8dce-4f80-b41b-6bc33f1cbb77 req-b3e06ed0-6580-4f7e-924a-9f0de4c46f2e service nova] Creating event network-vif-plugged:43551aa5-c58d-4fa4-ab62-60938bf7595a for instance 41fc3e49-00d7-473e-8aff-17796e05c84b on hv-cinder-84762 Jun 25 16:09:31.227314 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-60080e40-8dce-4f80-b41b-6bc33f1cbb77 req-b3e06ed0-6580-4f7e-924a-9f0de4c46f2e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047147 Jun 25 16:09:31.228622 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 196/391] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:09:31.668914 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-f2f9b9c4-9b30-4a63-8a1f-9a0835b99c37 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:31.669859 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-f2f9b9c4-9b30-4a63-8a1f-9a0835b99c37 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 41fc3e49-00d7-473e-8aff-17796e05c84b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:31.681934 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f2f9b9c4-9b30-4a63-8a1f-9a0835b99c37 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:31.682856 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f2f9b9c4-9b30-4a63-8a1f-9a0835b99c37 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:31.687787 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f2f9b9c4-9b30-4a63-8a1f-9a0835b99c37 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:31.688894 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f2f9b9c4-9b30-4a63-8a1f-9a0835b99c37 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:31.788281 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-29a9b9eb-fc9f-486a-aa77-767c9c54635a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:31.789053 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-29a9b9eb-fc9f-486a-aa77-767c9c54635a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 0d92f23b-4b14-4619-a2c9-a90bd96b27fd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:31.806190 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-29a9b9eb-fc9f-486a-aa77-767c9c54635a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:31.806649 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-29a9b9eb-fc9f-486a-aa77-767c9c54635a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:31.808126 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-29a9b9eb-fc9f-486a-aa77-767c9c54635a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:31.808605 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-29a9b9eb-fc9f-486a-aa77-767c9c54635a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:31.833311 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-29a9b9eb-fc9f-486a-aa77-767c9c54635a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] HTTP exception thrown: Instance 0d92f23b-4b14-4619-a2c9-a90bd96b27fd could not be found. Jun 25 16:09:31.835127 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-29a9b9eb-fc9f-486a-aa77-767c9c54635a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Request method failure captured: Jun 25 16:09:31.835127 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd HTTP/1.1 Jun 25 16:09:31.835127 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept: application/json Jun 25 16:09:31.835127 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jun 25 16:09:31.835127 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Connection: close Jun 25 16:09:31.835127 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jun 25 16:09:31.835127 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jun 25 16:09:31.835127 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Host: 10.222.0.13 Jun 25 16:09:31.835127 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jun 25 16:09:31.835127 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jun 25 16:09:31.835127 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABitzJ4VTX9FBO09dP9eDUNJ7kXDvOeQ_3800jobL_5yAtOgxQI54WUI0jlTKIeeP5rTVj0MTWBlkUxqhr419kWtC1O7I2ACk-hIdi2fMzwDg3khIX53lL7PAAWZJjGvTHF0eyDgeSSmpMCdU8rbC_7cLecxR6vp9KZlm3nwM3ZTo0XAYY Jun 25 16:09:31.835127 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jun 25 16:09:31.835127 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jun 25 16:09:31.835127 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jun 25 16:09:31.835127 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jun 25 16:09:31.835127 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jun 25 16:09:31.835127 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jun 25 16:09:31.835127 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Id: b1bba8f74dbd433bbffdb2ffbfc481fb Jun 25 16:09:31.835127 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:09:31.835127 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Role: reader,member Jun 25 16:09:31.835127 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Jun 25 16:09:31.836461 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b1bba8f74dbd433bbffdb2ffbfc481fb", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:09:31.836461 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:09:31.836461 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Id: b1bba8f74dbd433bbffdb2ffbfc481fb Jun 25 16:09:31.836461 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:09:31.836461 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeNegativeTest-1137598465-project Jun 25 16:09:31.836461 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jun 25 16:09:31.836461 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jun 25 16:09:31.836461 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Id: 19140330ae664e45b85f47f321496191 Jun 25 16:09:31.836461 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeNegativeTest-1137598465-project Jun 25 16:09:31.836461 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: method: > Jun 25 16:09:31.836461 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: exception: Instance 0d92f23b-4b14-4619-a2c9-a90bd96b27fd could not be found. Jun 25 16:09:31.836461 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: action_args: {'id': '0d92f23b-4b14-4619-a2c9-a90bd96b27fd'} Jun 25 16:09:31.837207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:09:31.837207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:09:31.837207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:09:31.837207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:09:31.837207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:09:31.837207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:09:31.837207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:09:31.837207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:09:31.837207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:09:31.837207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:09:31.837207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d92f23b-4b14-4619-a2c9-a90bd96b27fd could not be found. Jun 25 16:09:31.837207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:09:31.837207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:09:31.837207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:09:31.837207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:09:31.837207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:09:31.837207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:09:31.837207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:09:31.837207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:09:31.837207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:09:31.838853 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:09:31.838853 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 16:09:31.838853 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 16:09:31.838853 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:09:31.838853 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:09:31.838853 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:09:31.838853 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:09:31.838853 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d92f23b-4b14-4619-a2c9-a90bd96b27fd could not be found. Jun 25 16:09:31.838853 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:09:31.838853 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:09:31.838853 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:09:31.838853 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:09:31.838853 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:09:31.838853 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:09:31.838853 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:09:31.838853 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:09:31.838853 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d92f23b-4b14-4619-a2c9-a90bd96b27fd could not be found. Jun 25 16:09:31.838853 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:09:31.841172 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-29a9b9eb-fc9f-486a-aa77-767c9c54635a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Returning 404 to user: Instance 0d92f23b-4b14-4619-a2c9-a90bd96b27fd could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:09:31.841172 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-29a9b9eb-fc9f-486a-aa77-767c9c54635a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd" status: 404 len: 111 microversion: 2.1 time: 0.053695 Jun 25 16:09:31.841172 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 197/392] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:31 2022] GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 16:09:31.845602 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-cd603387-ace2-401f-9fba-401c131d309b tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '.version_select at 0x7f65c0185f70>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:31.893232 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-cd603387-ace2-401f-9fba-401c131d309b tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2021876115" status: 202 len: 0 microversion: 2.1 time: 0.050613 Jun 25 16:09:31.902111 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 198/393] 10.222.0.13 () {58 vars in 1220 bytes} [Sat Jun 25 16:09:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2021876115 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 16:09:31.964292 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-f2f9b9c4-9b30-4a63-8a1f-9a0835b99c37 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:31.976940 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-f2f9b9c4-9b30-4a63-8a1f-9a0835b99c37 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b" status: 200 len: 1318 microversion: 2.1 time: 0.314596 Jun 25 16:09:31.980688 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 196/394] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:31 2022] GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b => generated 1318 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:32.034033 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-0840efb0-83fc-42a2-a93b-c9fbbbf66da0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:32.034752 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0840efb0-83fc-42a2-a93b-c9fbbbf66da0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:32.043312 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0840efb0-83fc-42a2-a93b-c9fbbbf66da0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:32.043925 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0840efb0-83fc-42a2-a93b-c9fbbbf66da0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:32.044751 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0840efb0-83fc-42a2-a93b-c9fbbbf66da0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:32.045372 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0840efb0-83fc-42a2-a93b-c9fbbbf66da0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:32.298153 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-0840efb0-83fc-42a2-a93b-c9fbbbf66da0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:32.308878 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-0840efb0-83fc-42a2-a93b-c9fbbbf66da0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:32.310525 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-0840efb0-83fc-42a2-a93b-c9fbbbf66da0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:32.312009 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-0840efb0-83fc-42a2-a93b-c9fbbbf66da0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1723 microversion: 2.20 time: 0.282032 Jun 25 16:09:32.323940 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 199/395] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:09:32 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1723 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:09:32.828229 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-6637533f-d7cb-41fe-92a6-746b29fe9e1c tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:32.828935 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-6637533f-d7cb-41fe-92a6-746b29fe9e1c tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:32.835649 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6637533f-d7cb-41fe-92a6-746b29fe9e1c tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:32.836223 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6637533f-d7cb-41fe-92a6-746b29fe9e1c tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:32.837119 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6637533f-d7cb-41fe-92a6-746b29fe9e1c tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:32.837785 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6637533f-d7cb-41fe-92a6-746b29fe9e1c tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:32.940455 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.objects.instance [None req-6637533f-d7cb-41fe-92a6-746b29fe9e1c tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lazy-loading 'services' on Instance uuid 9dc4f0bb-0b30-429c-af92-a30f31e4b60f {{(pid=117794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 16:09:33.014321 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4ccd6b65-43cf-4747-91f2-bccf27796ccb tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:33.015402 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4ccd6b65-43cf-4747-91f2-bccf27796ccb tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 41fc3e49-00d7-473e-8aff-17796e05c84b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:33.042625 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4ccd6b65-43cf-4747-91f2-bccf27796ccb tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:33.045587 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4ccd6b65-43cf-4747-91f2-bccf27796ccb tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:33.046687 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4ccd6b65-43cf-4747-91f2-bccf27796ccb tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:33.048815 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4ccd6b65-43cf-4747-91f2-bccf27796ccb tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:33.117405 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-6637533f-d7cb-41fe-92a6-746b29fe9e1c tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f/os-volume_attachments/f1a2fa49-1d71-4c4e-80d4-0e3478ac3503" status: 202 len: 0 microversion: 2.1 time: 0.290275 Jun 25 16:09:33.139013 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 197/396] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Jun 25 16:09:32 2022] DELETE /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f/os-volume_attachments/f1a2fa49-1d71-4c4e-80d4-0e3478ac3503 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 16:09:33.145348 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-f0ba6af6-da86-48fe-99e8-087989b6decf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:33.146441 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-f0ba6af6-da86-48fe-99e8-087989b6decf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:33.153070 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f0ba6af6-da86-48fe-99e8-087989b6decf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:33.153522 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f0ba6af6-da86-48fe-99e8-087989b6decf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:33.154285 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f0ba6af6-da86-48fe-99e8-087989b6decf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:33.154714 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f0ba6af6-da86-48fe-99e8-087989b6decf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:33.185698 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-f0ba6af6-da86-48fe-99e8-087989b6decf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044903 Jun 25 16:09:33.186645 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 198/397] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Jun 25 16:09:33 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:09:33.225528 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4ccd6b65-43cf-4747-91f2-bccf27796ccb tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:33.234935 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4ccd6b65-43cf-4747-91f2-bccf27796ccb tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b" status: 200 len: 1318 microversion: 2.1 time: 0.227261 Jun 25 16:09:33.245159 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 200/398] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:32 2022] GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:33.331006 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-d3502bf5-5cca-434c-8ee6-2448ba5a7e88 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:33.331766 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-d3502bf5-5cca-434c-8ee6-2448ba5a7e88 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:33.340914 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d3502bf5-5cca-434c-8ee6-2448ba5a7e88 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:33.341362 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d3502bf5-5cca-434c-8ee6-2448ba5a7e88 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:33.342133 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d3502bf5-5cca-434c-8ee6-2448ba5a7e88 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:33.342590 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d3502bf5-5cca-434c-8ee6-2448ba5a7e88 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:33.515760 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d3502bf5-5cca-434c-8ee6-2448ba5a7e88 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:33.527108 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d3502bf5-5cca-434c-8ee6-2448ba5a7e88 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:33.529006 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d3502bf5-5cca-434c-8ee6-2448ba5a7e88 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:33.530364 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-d3502bf5-5cca-434c-8ee6-2448ba5a7e88 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1723 microversion: 2.20 time: 0.203674 Jun 25 16:09:33.530911 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 199/399] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:09:33 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:09:34.197902 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3b87c120-57f6-42e6-b44b-b2b90c8d2d37 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:34.198696 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3b87c120-57f6-42e6-b44b-b2b90c8d2d37 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:34.201320 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:09:34.207031 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3b87c120-57f6-42e6-b44b-b2b90c8d2d37 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:34.207727 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3b87c120-57f6-42e6-b44b-b2b90c8d2d37 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:34.208755 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3b87c120-57f6-42e6-b44b-b2b90c8d2d37 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:34.209339 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3b87c120-57f6-42e6-b44b-b2b90c8d2d37 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:34.249306 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3b87c120-57f6-42e6-b44b-b2b90c8d2d37 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055904 Jun 25 16:09:34.253021 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-cad5259f-c9ac-4aac-8873-1e7071364aef tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:34.253893 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 201/400] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Jun 25 16:09:34 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:09:34.254721 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-cad5259f-c9ac-4aac-8873-1e7071364aef tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 41fc3e49-00d7-473e-8aff-17796e05c84b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:34.265515 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cad5259f-c9ac-4aac-8873-1e7071364aef tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:34.265995 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cad5259f-c9ac-4aac-8873-1e7071364aef tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:34.266772 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cad5259f-c9ac-4aac-8873-1e7071364aef tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:34.267430 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cad5259f-c9ac-4aac-8873-1e7071364aef tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:34.460375 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-cad5259f-c9ac-4aac-8873-1e7071364aef tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:34.471896 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-cad5259f-c9ac-4aac-8873-1e7071364aef tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b" status: 200 len: 1508 microversion: 2.1 time: 0.222119 Jun 25 16:09:34.484448 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 200/401] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:34 2022] GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b => generated 1508 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:34.493024 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-12f134c5-dc13-43a3-ba1c-7361c6e25d76 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d92dbb1-67cd-49c2-ab1a-f8171293b4a0", "device": "/dev/sdb"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:09:34.494650 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-12f134c5-dc13-43a3-ba1c-7361c6e25d76 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 41fc3e49-00d7-473e-8aff-17796e05c84b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:34.503389 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-12f134c5-dc13-43a3-ba1c-7361c6e25d76 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:34.504245 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-12f134c5-dc13-43a3-ba1c-7361c6e25d76 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:34.506472 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-12f134c5-dc13-43a3-ba1c-7361c6e25d76 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:34.508765 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-12f134c5-dc13-43a3-ba1c-7361c6e25d76 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:34.549057 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-70abb89a-74ce-48c5-b197-ecd9866da3c2 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:34.550094 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-70abb89a-74ce-48c5-b197-ecd9866da3c2 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:34.561120 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-70abb89a-74ce-48c5-b197-ecd9866da3c2 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:34.561828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-70abb89a-74ce-48c5-b197-ecd9866da3c2 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:34.562961 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-70abb89a-74ce-48c5-b197-ecd9866da3c2 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:34.563680 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-70abb89a-74ce-48c5-b197-ecd9866da3c2 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:34.738739 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-70abb89a-74ce-48c5-b197-ecd9866da3c2 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:34.748128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-70abb89a-74ce-48c5-b197-ecd9866da3c2 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:34.750316 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-70abb89a-74ce-48c5-b197-ecd9866da3c2 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:34.752030 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-70abb89a-74ce-48c5-b197-ecd9866da3c2 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1723 microversion: 2.20 time: 0.207317 Jun 25 16:09:34.763460 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 201/402] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:09:34 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:09:34.869321 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-12f134c5-dc13-43a3-ba1c-7361c6e25d76 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "POST /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.380639 Jun 25 16:09:34.876486 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 202/403] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Jun 25 16:09:34 2022] POST /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b/os-volume_attachments => generated 194 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 16:09:35.261982 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-7ad97417-064f-4fd6-bc49-3727b91b31d3 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:35.263923 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-7ad97417-064f-4fd6-bc49-3727b91b31d3 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:35.272572 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7ad97417-064f-4fd6-bc49-3727b91b31d3 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:35.273412 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7ad97417-064f-4fd6-bc49-3727b91b31d3 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:35.274221 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7ad97417-064f-4fd6-bc49-3727b91b31d3 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:35.274844 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7ad97417-064f-4fd6-bc49-3727b91b31d3 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:35.307036 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-7ad97417-064f-4fd6-bc49-3727b91b31d3 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049265 Jun 25 16:09:35.309104 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 202/404] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Jun 25 16:09:35 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 16:09:35.371471 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-487ce6c7-615c-4e77-b056-f69e2aadb3cf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:35.372633 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-487ce6c7-615c-4e77-b056-f69e2aadb3cf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:35.380932 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-487ce6c7-615c-4e77-b056-f69e2aadb3cf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:35.381716 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-487ce6c7-615c-4e77-b056-f69e2aadb3cf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:35.382517 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-487ce6c7-615c-4e77-b056-f69e2aadb3cf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:35.383122 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-487ce6c7-615c-4e77-b056-f69e2aadb3cf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:35.411997 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-487ce6c7-615c-4e77-b056-f69e2aadb3cf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 16:09:35.519904 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-487ce6c7-615c-4e77-b056-f69e2aadb3cf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 204 len: 0 microversion: 2.1 time: 0.150825 Jun 25 16:09:35.520985 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 203/405] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Jun 25 16:09:35 2022] DELETE /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 16:09:35.532046 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-12a01810-cb9e-4f19-a847-3256bffb194b tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:35.533140 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-12a01810-cb9e-4f19-a847-3256bffb194b tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:35.541709 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-12a01810-cb9e-4f19-a847-3256bffb194b tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:35.542301 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-12a01810-cb9e-4f19-a847-3256bffb194b tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:35.543244 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-12a01810-cb9e-4f19-a847-3256bffb194b tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:35.543784 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-12a01810-cb9e-4f19-a847-3256bffb194b tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:35.688888 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-12a01810-cb9e-4f19-a847-3256bffb194b tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:35.697748 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-12a01810-cb9e-4f19-a847-3256bffb194b tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1682 microversion: 2.1 time: 0.171319 Jun 25 16:09:35.698345 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 203/406] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:35 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:09:35.774924 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e26b2b65-9bd3-4d5b-88af-14c823f05d4f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:35.776345 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e26b2b65-9bd3-4d5b-88af-14c823f05d4f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:35.787795 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e26b2b65-9bd3-4d5b-88af-14c823f05d4f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:35.788657 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e26b2b65-9bd3-4d5b-88af-14c823f05d4f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:35.789704 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e26b2b65-9bd3-4d5b-88af-14c823f05d4f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:35.790616 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e26b2b65-9bd3-4d5b-88af-14c823f05d4f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:35.960742 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e26b2b65-9bd3-4d5b-88af-14c823f05d4f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:35.969332 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e26b2b65-9bd3-4d5b-88af-14c823f05d4f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:35.970898 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e26b2b65-9bd3-4d5b-88af-14c823f05d4f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:35.972522 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e26b2b65-9bd3-4d5b-88af-14c823f05d4f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1723 microversion: 2.20 time: 0.204447 Jun 25 16:09:35.980466 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 204/407] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:09:35 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:09:36.715685 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-84e5067c-4f3e-4b4e-ba20-ca077a6bd561 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:36.716320 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-84e5067c-4f3e-4b4e-ba20-ca077a6bd561 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:36.724037 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-84e5067c-4f3e-4b4e-ba20-ca077a6bd561 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:36.724547 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-84e5067c-4f3e-4b4e-ba20-ca077a6bd561 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:36.725620 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-84e5067c-4f3e-4b4e-ba20-ca077a6bd561 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:36.726228 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-84e5067c-4f3e-4b4e-ba20-ca077a6bd561 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:36.879112 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-84e5067c-4f3e-4b4e-ba20-ca077a6bd561 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:36.887503 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-84e5067c-4f3e-4b4e-ba20-ca077a6bd561 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1682 microversion: 2.1 time: 0.175839 Jun 25 16:09:36.892583 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 204/408] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:36 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:36.993523 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a8f149cc-2437-4755-abc5-6237474bac80 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:36.994450 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a8f149cc-2437-4755-abc5-6237474bac80 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:37.004224 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a8f149cc-2437-4755-abc5-6237474bac80 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:37.005673 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a8f149cc-2437-4755-abc5-6237474bac80 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:37.006885 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a8f149cc-2437-4755-abc5-6237474bac80 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:37.007623 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a8f149cc-2437-4755-abc5-6237474bac80 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:37.205430 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a8f149cc-2437-4755-abc5-6237474bac80 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:37.216228 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a8f149cc-2437-4755-abc5-6237474bac80 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:37.218795 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a8f149cc-2437-4755-abc5-6237474bac80 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:37.220707 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a8f149cc-2437-4755-abc5-6237474bac80 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1723 microversion: 2.20 time: 0.233512 Jun 25 16:09:37.222296 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 205/409] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:09:36 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:09:37.913454 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-6e148be1-c329-418d-8e34-fd318d7ea409 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:37.919275 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-6e148be1-c329-418d-8e34-fd318d7ea409 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:37.931801 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6e148be1-c329-418d-8e34-fd318d7ea409 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:37.933763 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6e148be1-c329-418d-8e34-fd318d7ea409 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:37.936046 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6e148be1-c329-418d-8e34-fd318d7ea409 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:37.937611 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6e148be1-c329-418d-8e34-fd318d7ea409 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:38.225555 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-6e148be1-c329-418d-8e34-fd318d7ea409 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:38.233331 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-6e148be1-c329-418d-8e34-fd318d7ea409 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1682 microversion: 2.1 time: 0.330694 Jun 25 16:09:38.235072 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 205/410] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:37 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1682 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:38.240613 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-fe0384fa-ae43-4795-b3ae-42f3e5b5f4ea tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:38.241804 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-fe0384fa-ae43-4795-b3ae-42f3e5b5f4ea tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:38.255135 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fe0384fa-ae43-4795-b3ae-42f3e5b5f4ea tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:38.255880 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fe0384fa-ae43-4795-b3ae-42f3e5b5f4ea tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:38.256848 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fe0384fa-ae43-4795-b3ae-42f3e5b5f4ea tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:38.257417 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fe0384fa-ae43-4795-b3ae-42f3e5b5f4ea tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:38.532452 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fe0384fa-ae43-4795-b3ae-42f3e5b5f4ea tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:38.541890 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fe0384fa-ae43-4795-b3ae-42f3e5b5f4ea tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:38.543800 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fe0384fa-ae43-4795-b3ae-42f3e5b5f4ea tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:38.545163 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-fe0384fa-ae43-4795-b3ae-42f3e5b5f4ea tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1723 microversion: 2.20 time: 0.308965 Jun 25 16:09:38.557423 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 206/411] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:09:38 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1723 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:09:38.786302 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-95bfbd50-f240-45a4-bf6c-6b71a2da2bd8 req-dc3606b2-4c54-4b73-a2eb-0503ad34c192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dc4f0bb-0b30-429c-af92-a30f31e4b60f", "name": "network-vif-deleted", "tag": "da8ae9de-1432-4b4c-9379-90aae9bf04a3"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:09:38.799121 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-95bfbd50-f240-45a4-bf6c-6b71a2da2bd8 req-dc3606b2-4c54-4b73-a2eb-0503ad34c192 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:38.799638 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-95bfbd50-f240-45a4-bf6c-6b71a2da2bd8 req-dc3606b2-4c54-4b73-a2eb-0503ad34c192 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:38.813348 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-95bfbd50-f240-45a4-bf6c-6b71a2da2bd8 req-dc3606b2-4c54-4b73-a2eb-0503ad34c192 service nova] Creating event network-vif-deleted:da8ae9de-1432-4b4c-9379-90aae9bf04a3 for instance 9dc4f0bb-0b30-429c-af92-a30f31e4b60f on hv-cinder-84762 Jun 25 16:09:38.819701 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-95bfbd50-f240-45a4-bf6c-6b71a2da2bd8 req-dc3606b2-4c54-4b73-a2eb-0503ad34c192 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037716 Jun 25 16:09:38.820361 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 206/412] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:09:39.251353 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-fc7b46c9-feeb-4bba-9083-e25774e2fcc0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:39.259474 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-fc7b46c9-feeb-4bba-9083-e25774e2fcc0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:39.272099 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fc7b46c9-feeb-4bba-9083-e25774e2fcc0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:39.272840 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fc7b46c9-feeb-4bba-9083-e25774e2fcc0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:39.273975 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fc7b46c9-feeb-4bba-9083-e25774e2fcc0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:39.274554 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fc7b46c9-feeb-4bba-9083-e25774e2fcc0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:39.346093 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fc7b46c9-feeb-4bba-9083-e25774e2fcc0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:39.347028 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fc7b46c9-feeb-4bba-9083-e25774e2fcc0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:39.347712 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-fc7b46c9-feeb-4bba-9083-e25774e2fcc0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lazy-loading 'fault' on Instance uuid 9dc4f0bb-0b30-429c-af92-a30f31e4b60f {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 16:09:39.416257 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fc7b46c9-feeb-4bba-9083-e25774e2fcc0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:39.427879 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-fc7b46c9-feeb-4bba-9083-e25774e2fcc0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 200 len: 1331 microversion: 2.1 time: 0.179940 Jun 25 16:09:39.429498 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 207/413] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:39 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 1331 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:39.564824 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-f712420a-cf96-46dd-87e7-1bc512c665f1 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:39.566480 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-f712420a-cf96-46dd-87e7-1bc512c665f1 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:39.575588 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f712420a-cf96-46dd-87e7-1bc512c665f1 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:39.576066 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f712420a-cf96-46dd-87e7-1bc512c665f1 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:39.577159 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f712420a-cf96-46dd-87e7-1bc512c665f1 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:39.577795 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f712420a-cf96-46dd-87e7-1bc512c665f1 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:39.733158 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-f712420a-cf96-46dd-87e7-1bc512c665f1 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:39.743014 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-f712420a-cf96-46dd-87e7-1bc512c665f1 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:39.745092 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-f712420a-cf96-46dd-87e7-1bc512c665f1 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:39.746693 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-f712420a-cf96-46dd-87e7-1bc512c665f1 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1723 microversion: 2.20 time: 0.186131 Jun 25 16:09:39.759544 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 207/414] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:09:39 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:09:40.446141 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-39e5d875-c653-4008-ba09-39ec3c1e03a8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:40.447048 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-39e5d875-c653-4008-ba09-39ec3c1e03a8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:40.454785 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-39e5d875-c653-4008-ba09-39ec3c1e03a8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:40.455524 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-39e5d875-c653-4008-ba09-39ec3c1e03a8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:40.457377 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-39e5d875-c653-4008-ba09-39ec3c1e03a8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:40.457878 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-39e5d875-c653-4008-ba09-39ec3c1e03a8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:40.462360 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:09:40.476453 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-39e5d875-c653-4008-ba09-39ec3c1e03a8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] HTTP exception thrown: Instance 9dc4f0bb-0b30-429c-af92-a30f31e4b60f could not be found. Jun 25 16:09:40.478618 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-39e5d875-c653-4008-ba09-39ec3c1e03a8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Request method failure captured: Jun 25 16:09:40.478618 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f HTTP/1.1 Jun 25 16:09:40.478618 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept: application/json Jun 25 16:09:40.478618 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jun 25 16:09:40.478618 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Connection: close Jun 25 16:09:40.478618 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jun 25 16:09:40.478618 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jun 25 16:09:40.478618 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Host: 10.222.0.13 Jun 25 16:09:40.478618 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jun 25 16:09:40.478618 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jun 25 16:09:40.478618 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABitzJ4VTX9FBO09dP9eDUNJ7kXDvOeQ_3800jobL_5yAtOgxQI54WUI0jlTKIeeP5rTVj0MTWBlkUxqhr419kWtC1O7I2ACk-hIdi2fMzwDg3khIX53lL7PAAWZJjGvTHF0eyDgeSSmpMCdU8rbC_7cLecxR6vp9KZlm3nwM3ZTo0XAYY Jun 25 16:09:40.478618 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jun 25 16:09:40.478618 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jun 25 16:09:40.478618 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jun 25 16:09:40.478618 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jun 25 16:09:40.478618 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jun 25 16:09:40.478618 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jun 25 16:09:40.478618 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Id: b1bba8f74dbd433bbffdb2ffbfc481fb Jun 25 16:09:40.478618 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:09:40.478618 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Role: reader,member Jun 25 16:09:40.478618 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Jun 25 16:09:40.480104 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b1bba8f74dbd433bbffdb2ffbfc481fb", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:09:40.480104 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:09:40.480104 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Id: b1bba8f74dbd433bbffdb2ffbfc481fb Jun 25 16:09:40.480104 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:09:40.480104 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeNegativeTest-1137598465-project Jun 25 16:09:40.480104 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jun 25 16:09:40.480104 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jun 25 16:09:40.480104 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Id: 19140330ae664e45b85f47f321496191 Jun 25 16:09:40.480104 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeNegativeTest-1137598465-project Jun 25 16:09:40.480104 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: method: > Jun 25 16:09:40.480104 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: exception: Instance 9dc4f0bb-0b30-429c-af92-a30f31e4b60f could not be found. Jun 25 16:09:40.480104 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: action_args: {'id': '9dc4f0bb-0b30-429c-af92-a30f31e4b60f'} Jun 25 16:09:40.481000 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:09:40.481000 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:09:40.481000 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:09:40.481000 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:09:40.481000 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:09:40.481000 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:09:40.481000 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:09:40.481000 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:09:40.481000 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:09:40.481000 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:09:40.481000 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dc4f0bb-0b30-429c-af92-a30f31e4b60f could not be found. Jun 25 16:09:40.481000 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:09:40.481000 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:09:40.481000 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:09:40.481000 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:09:40.481000 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:09:40.481000 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:09:40.481000 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:09:40.481000 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:09:40.481000 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:09:40.482400 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:09:40.482400 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 16:09:40.482400 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 16:09:40.482400 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:09:40.482400 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:09:40.482400 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:09:40.482400 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:09:40.482400 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dc4f0bb-0b30-429c-af92-a30f31e4b60f could not be found. Jun 25 16:09:40.482400 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:09:40.482400 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:09:40.482400 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:09:40.482400 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:09:40.482400 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:09:40.482400 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:09:40.482400 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:09:40.482400 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:09:40.482400 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dc4f0bb-0b30-429c-af92-a30f31e4b60f could not be found. Jun 25 16:09:40.482400 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:09:40.484332 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-39e5d875-c653-4008-ba09-39ec3c1e03a8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Returning 404 to user: Instance 9dc4f0bb-0b30-429c-af92-a30f31e4b60f could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:09:40.485212 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-39e5d875-c653-4008-ba09-39ec3c1e03a8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 404 len: 111 microversion: 2.1 time: 0.043171 Jun 25 16:09:40.485776 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 208/415] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:40 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:09:40.495067 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-dd2a4141-11f2-4059-8b7f-1af4332cc49a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '.version_select at 0x7f65bbf24e50>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:40.501308 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:09:40.518324 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-dd2a4141-11f2-4059-8b7f-1af4332cc49a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2099754676" status: 202 len: 0 microversion: 2.1 time: 0.026607 Jun 25 16:09:40.519267 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 208/416] 10.222.0.13 () {58 vars in 1220 bytes} [Sat Jun 25 16:09:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2099754676 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 16:09:40.766799 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9aaa4bb7-38a7-469b-bdcd-8848a60dc7a4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:40.767720 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9aaa4bb7-38a7-469b-bdcd-8848a60dc7a4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:40.775226 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9aaa4bb7-38a7-469b-bdcd-8848a60dc7a4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:40.777185 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9aaa4bb7-38a7-469b-bdcd-8848a60dc7a4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:40.778085 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9aaa4bb7-38a7-469b-bdcd-8848a60dc7a4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:40.778746 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9aaa4bb7-38a7-469b-bdcd-8848a60dc7a4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:41.029295 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9aaa4bb7-38a7-469b-bdcd-8848a60dc7a4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:41.042491 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9aaa4bb7-38a7-469b-bdcd-8848a60dc7a4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:41.044577 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9aaa4bb7-38a7-469b-bdcd-8848a60dc7a4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:41.046691 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9aaa4bb7-38a7-469b-bdcd-8848a60dc7a4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1723 microversion: 2.20 time: 0.284034 Jun 25 16:09:41.061839 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 209/417] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:09:40 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1723 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:09:41.692968 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-b9b4c282-b3d0-465c-8f32-48b212ca4d02 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Action: 'create', calling method: .version_select at 0x7f65bb673a60>, body: {"keypair": {"name": "tempest-keypair-88150719", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNLuMHfw/rHrzfoYEiar6hSHXY4v71Eku0XcYNJqF5dbs0M2cdYWmxEQxEfbNZyOf+keaAYiYpC6lMduAvywDdCxsGgTgKmRCYgWPCS7wHU/xKyg9Yd6uzQd4UOyJ/QhwQ=="}} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:09:41.711517 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.quota [None req-b9b4c282-b3d0-465c-8f32-48b212ca4d02 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Getting quotas for project b1bba8f74dbd433bbffdb2ffbfc481fb. Resources: {'key_pairs'} {{(pid=117794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:09:41.716431 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.quota [None req-b9b4c282-b3d0-465c-8f32-48b212ca4d02 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Getting quotas for user 19140330ae664e45b85f47f321496191 and project b1bba8f74dbd433bbffdb2ffbfc481fb. Resources: {'key_pairs'} {{(pid=117794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:09:41.745279 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-b9b4c282-b3d0-465c-8f32-48b212ca4d02 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.056781 Jun 25 16:09:41.746263 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 209/418] 10.222.0.13 () {60 vars in 1158 bytes} [Sat Jun 25 16:09:41 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:09:42.064832 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b55ba05d-6f76-4691-becc-b597b22d491a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:42.066131 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b55ba05d-6f76-4691-becc-b597b22d491a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:42.077852 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b55ba05d-6f76-4691-becc-b597b22d491a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:42.077852 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b55ba05d-6f76-4691-becc-b597b22d491a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:42.077852 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b55ba05d-6f76-4691-becc-b597b22d491a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:42.077852 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b55ba05d-6f76-4691-becc-b597b22d491a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:42.333849 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b55ba05d-6f76-4691-becc-b597b22d491a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:42.349013 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b55ba05d-6f76-4691-becc-b597b22d491a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:42.351141 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b55ba05d-6f76-4691-becc-b597b22d491a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:42.353101 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b55ba05d-6f76-4691-becc-b597b22d491a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1723 microversion: 2.20 time: 0.292475 Jun 25 16:09:42.369848 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 210/419] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:09:42 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1723 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:09:43.372143 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-4f9fb08d-5878-4afe-a8a9-08b44aa6b60a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:43.373154 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-4f9fb08d-5878-4afe-a8a9-08b44aa6b60a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:43.379561 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4f9fb08d-5878-4afe-a8a9-08b44aa6b60a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:43.380010 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4f9fb08d-5878-4afe-a8a9-08b44aa6b60a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:43.380816 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4f9fb08d-5878-4afe-a8a9-08b44aa6b60a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:43.381249 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4f9fb08d-5878-4afe-a8a9-08b44aa6b60a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:43.400138 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:09:43.471186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b42263b1-c2d8-45e5-8f0c-2159d5003ce0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-975319751", "imageRef": "84c164fa-276d-4693-b7a0-24fd3024b359", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "92184934-9929-49a5-91f4-1ab03b25e2f1"}], "security_groups": [{"name": "tempest-securitygroup--418271118"}], "key_name": "tempest-keypair-88150719", "user_data": "}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:09:43.563348 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-4f9fb08d-5878-4afe-a8a9-08b44aa6b60a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:43.572075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-4f9fb08d-5878-4afe-a8a9-08b44aa6b60a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:43.573609 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-4f9fb08d-5878-4afe-a8a9-08b44aa6b60a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:43.574752 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-4f9fb08d-5878-4afe-a8a9-08b44aa6b60a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1744 microversion: 2.20 time: 0.207403 Jun 25 16:09:43.575324 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 210/420] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:09:43 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1744 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:09:43.594597 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-b42263b1-c2d8-45e5-8f0c-2159d5003ce0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] validate_networks() for [('92184934-9929-49a5-91f4-1ab03b25e2f1', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 16:09:44.022665 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-b42263b1-c2d8-45e5-8f0c-2159d5003ce0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 16:09:44.023081 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-b42263b1-c2d8-45e5-8f0c-2159d5003ce0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 16:09:44.023544 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-b42263b1-c2d8-45e5-8f0c-2159d5003ce0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 16:09:44.023972 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-b42263b1-c2d8-45e5-8f0c-2159d5003ce0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 16:09:44.024371 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-b42263b1-c2d8-45e5-8f0c-2159d5003ce0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 16:09:44.034690 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b42263b1-c2d8-45e5-8f0c-2159d5003ce0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:44.035135 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b42263b1-c2d8-45e5-8f0c-2159d5003ce0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:44.035924 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b42263b1-c2d8-45e5-8f0c-2159d5003ce0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:44.036348 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b42263b1-c2d8-45e5-8f0c-2159d5003ce0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:44.053226 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-b42263b1-c2d8-45e5-8f0c-2159d5003ce0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Getting quotas for project b1bba8f74dbd433bbffdb2ffbfc481fb. Resources: {'ram', 'cores', 'instances'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:09:44.057333 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-b42263b1-c2d8-45e5-8f0c-2159d5003ce0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Getting quotas for user 19140330ae664e45b85f47f321496191 and project b1bba8f74dbd433bbffdb2ffbfc481fb. Resources: {'ram', 'cores', 'instances'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:09:44.068797 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b42263b1-c2d8-45e5-8f0c-2159d5003ce0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 16:09:44.071070 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b42263b1-c2d8-45e5-8f0c-2159d5003ce0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84c164fa-276d-4693-b7a0-24fd3024b359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 16:09:44.119030 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b42263b1-c2d8-45e5-8f0c-2159d5003ce0 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.652092 Jun 25 16:09:44.119670 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 211/421] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Jun 25 16:09:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 25 16:09:44.132829 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-bb432163-906f-43b2-b8f7-81f339ddf358 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:44.133446 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-bb432163-906f-43b2-b8f7-81f339ddf358 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:44.188926 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-bb432163-906f-43b2-b8f7-81f339ddf358 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:44.196943 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-bb432163-906f-43b2-b8f7-81f339ddf358 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9" status: 200 len: 1239 microversion: 2.1 time: 0.069682 Jun 25 16:09:44.197536 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 211/422] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:44 2022] GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 => generated 1239 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:44.594424 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-62fe7539-592a-4036-a93b-22078d804da5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:44.595032 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-62fe7539-592a-4036-a93b-22078d804da5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:44.601528 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-62fe7539-592a-4036-a93b-22078d804da5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:44.601977 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-62fe7539-592a-4036-a93b-22078d804da5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:44.602745 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-62fe7539-592a-4036-a93b-22078d804da5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:44.603181 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-62fe7539-592a-4036-a93b-22078d804da5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:44.757791 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-62fe7539-592a-4036-a93b-22078d804da5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:44.766130 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-62fe7539-592a-4036-a93b-22078d804da5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:44.767638 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-62fe7539-592a-4036-a93b-22078d804da5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:44.768885 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-62fe7539-592a-4036-a93b-22078d804da5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1744 microversion: 2.20 time: 0.179145 Jun 25 16:09:44.769446 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 212/423] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:09:44 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1744 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:09:45.199545 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-67bd2956-8fba-4c5f-aa52-e6989c7c9204 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c7a77e46-f8e7-4dad-b3d5-9b120e204547"}} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:09:45.201481 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-67bd2956-8fba-4c5f-aa52-e6989c7c9204 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:45.210887 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-67bd2956-8fba-4c5f-aa52-e6989c7c9204 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:45.211335 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-67bd2956-8fba-4c5f-aa52-e6989c7c9204 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:45.212102 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-67bd2956-8fba-4c5f-aa52-e6989c7c9204 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:45.212571 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-67bd2956-8fba-4c5f-aa52-e6989c7c9204 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:45.214641 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-0bc593e5-dbd5-4500-8eb4-8351644dce60 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:45.215417 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0bc593e5-dbd5-4500-8eb4-8351644dce60 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:45.221319 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0bc593e5-dbd5-4500-8eb4-8351644dce60 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:45.221961 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0bc593e5-dbd5-4500-8eb4-8351644dce60 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:45.222818 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0bc593e5-dbd5-4500-8eb4-8351644dce60 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:45.223256 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0bc593e5-dbd5-4500-8eb4-8351644dce60 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:45.285084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-0bc593e5-dbd5-4500-8eb4-8351644dce60 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:45.293262 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-0bc593e5-dbd5-4500-8eb4-8351644dce60 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9" status: 200 len: 1243 microversion: 2.1 time: 0.082319 Jun 25 16:09:45.293807 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 213/424] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:45 2022] GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 => generated 1243 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:45.787013 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-39e763ae-d995-4829-a16e-05bec16eff87 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:45.787644 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-39e763ae-d995-4829-a16e-05bec16eff87 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:45.794291 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-39e763ae-d995-4829-a16e-05bec16eff87 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:45.794735 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-39e763ae-d995-4829-a16e-05bec16eff87 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:45.795489 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-39e763ae-d995-4829-a16e-05bec16eff87 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:45.795920 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-39e763ae-d995-4829-a16e-05bec16eff87 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:45.930425 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-39e763ae-d995-4829-a16e-05bec16eff87 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:45.943711 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-39e763ae-d995-4829-a16e-05bec16eff87 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:45.946102 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-39e763ae-d995-4829-a16e-05bec16eff87 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:45.947935 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-39e763ae-d995-4829-a16e-05bec16eff87 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1744 microversion: 2.20 time: 0.164557 Jun 25 16:09:45.948879 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 214/425] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:09:45 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:09:46.310587 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-cb6be913-6ec7-42ef-8856-24f720a317c7 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:46.311197 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-cb6be913-6ec7-42ef-8856-24f720a317c7 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:46.318218 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cb6be913-6ec7-42ef-8856-24f720a317c7 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:46.318674 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cb6be913-6ec7-42ef-8856-24f720a317c7 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:46.319439 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cb6be913-6ec7-42ef-8856-24f720a317c7 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:46.319906 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cb6be913-6ec7-42ef-8856-24f720a317c7 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:46.385942 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-cb6be913-6ec7-42ef-8856-24f720a317c7 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:46.395705 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-cb6be913-6ec7-42ef-8856-24f720a317c7 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9" status: 200 len: 1243 microversion: 2.1 time: 0.089074 Jun 25 16:09:46.396321 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 215/426] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:46 2022] GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 => generated 1243 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:46.568785 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-67bd2956-8fba-4c5f-aa52-e6989c7c9204 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "POST /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.376170 Jun 25 16:09:46.569345 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 212/427] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Jun 25 16:09:45 2022] POST /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9/os-volume_attachments => generated 194 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:09:46.971816 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9e4c3f16-6919-477f-9135-c06c0b54d9e5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:46.972450 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9e4c3f16-6919-477f-9135-c06c0b54d9e5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:46.980618 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9e4c3f16-6919-477f-9135-c06c0b54d9e5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:46.981063 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9e4c3f16-6919-477f-9135-c06c0b54d9e5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:46.981806 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9e4c3f16-6919-477f-9135-c06c0b54d9e5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:46.982232 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9e4c3f16-6919-477f-9135-c06c0b54d9e5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:47.118911 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9e4c3f16-6919-477f-9135-c06c0b54d9e5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:47.127414 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9e4c3f16-6919-477f-9135-c06c0b54d9e5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:47.129163 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9e4c3f16-6919-477f-9135-c06c0b54d9e5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:47.130403 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9e4c3f16-6919-477f-9135-c06c0b54d9e5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1744 microversion: 2.20 time: 0.164642 Jun 25 16:09:47.131047 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 216/428] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:09:46 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1744 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:09:47.413950 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-00cd73d2-09bc-45a1-9d30-25310759ff19 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:47.414943 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-00cd73d2-09bc-45a1-9d30-25310759ff19 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:47.421789 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-00cd73d2-09bc-45a1-9d30-25310759ff19 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:47.422762 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-00cd73d2-09bc-45a1-9d30-25310759ff19 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:47.424373 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-00cd73d2-09bc-45a1-9d30-25310759ff19 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:47.425031 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-00cd73d2-09bc-45a1-9d30-25310759ff19 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:47.525707 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-00cd73d2-09bc-45a1-9d30-25310759ff19 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:47.538117 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-00cd73d2-09bc-45a1-9d30-25310759ff19 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9" status: 200 len: 1297 microversion: 2.1 time: 0.128342 Jun 25 16:09:47.539293 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 213/429] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:47 2022] GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 => generated 1297 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:48.150505 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8e63213d-09cc-4415-8a7b-91217509a657 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:48.151816 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8e63213d-09cc-4415-8a7b-91217509a657 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:48.161927 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8e63213d-09cc-4415-8a7b-91217509a657 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:48.162404 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8e63213d-09cc-4415-8a7b-91217509a657 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:48.163154 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8e63213d-09cc-4415-8a7b-91217509a657 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:48.167659 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8e63213d-09cc-4415-8a7b-91217509a657 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:48.520068 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8e63213d-09cc-4415-8a7b-91217509a657 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:48.528053 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8e63213d-09cc-4415-8a7b-91217509a657 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:48.530027 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8e63213d-09cc-4415-8a7b-91217509a657 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:48.532505 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8e63213d-09cc-4415-8a7b-91217509a657 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1739 microversion: 2.20 time: 0.386926 Jun 25 16:09:48.545151 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 217/430] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:09:48 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1739 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 16:09:48.560083 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-00127d95-ea30-4645-9b67-198f8d802b7c tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:48.561319 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-00127d95-ea30-4645-9b67-198f8d802b7c tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:48.568548 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-00127d95-ea30-4645-9b67-198f8d802b7c tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:48.569217 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-00127d95-ea30-4645-9b67-198f8d802b7c tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:48.570175 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-00127d95-ea30-4645-9b67-198f8d802b7c tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:48.570771 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-00127d95-ea30-4645-9b67-198f8d802b7c tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:48.789319 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-00127d95-ea30-4645-9b67-198f8d802b7c tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:48.806629 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-00127d95-ea30-4645-9b67-198f8d802b7c tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9" status: 200 len: 1364 microversion: 2.1 time: 0.250601 Jun 25 16:09:48.816642 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 214/431] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:48 2022] GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 => generated 1364 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:49.138553 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-fa4de833-f7e1-4d82-b87b-697be71633f3 req-9a4e1357-851d-4441-8bd8-bf7b9227e532 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9", "tag": "c9f4f158-6c65-4bbe-8425-f8fcb9a31e68"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:09:49.155632 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-fa4de833-f7e1-4d82-b87b-697be71633f3 req-9a4e1357-851d-4441-8bd8-bf7b9227e532 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:49.156294 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-fa4de833-f7e1-4d82-b87b-697be71633f3 req-9a4e1357-851d-4441-8bd8-bf7b9227e532 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:49.179949 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-fa4de833-f7e1-4d82-b87b-697be71633f3 req-9a4e1357-851d-4441-8bd8-bf7b9227e532 service nova] Creating event network-changed:c9f4f158-6c65-4bbe-8425-f8fcb9a31e68 for instance b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 on hv-cinder-84762 Jun 25 16:09:49.191607 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-fa4de833-f7e1-4d82-b87b-697be71633f3 req-9a4e1357-851d-4441-8bd8-bf7b9227e532 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056398 Jun 25 16:09:49.192216 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 218/432] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:09:49.519544 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-5e658633-7d3f-4f3a-a111-7ace539f78b1 req-a735e435-b515-4311-9285-612c8bc5f3cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6ae5a58-db83-401e-a158-ebf0981e84ec", "name": "network-vif-plugged", "status": "completed", "tag": "3115b4bc-8a8e-494e-90f7-66772013aaf5"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:09:49.537555 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-5e658633-7d3f-4f3a-a111-7ace539f78b1 req-a735e435-b515-4311-9285-612c8bc5f3cd service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:49.544750 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-5e658633-7d3f-4f3a-a111-7ace539f78b1 req-a735e435-b515-4311-9285-612c8bc5f3cd service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:49.552996 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6840b488-c0f5-4a60-a7e1-f7ad63e681e4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:49.553971 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6840b488-c0f5-4a60-a7e1-f7ad63e681e4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:49.566224 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6840b488-c0f5-4a60-a7e1-f7ad63e681e4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:49.566675 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6840b488-c0f5-4a60-a7e1-f7ad63e681e4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:49.567452 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6840b488-c0f5-4a60-a7e1-f7ad63e681e4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:49.567555 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-5e658633-7d3f-4f3a-a111-7ace539f78b1 req-a735e435-b515-4311-9285-612c8bc5f3cd service nova] Creating event network-vif-plugged:3115b4bc-8a8e-494e-90f7-66772013aaf5 for instance e6ae5a58-db83-401e-a158-ebf0981e84ec on hv-cinder-84762 Jun 25 16:09:49.567972 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6840b488-c0f5-4a60-a7e1-f7ad63e681e4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:49.589151 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-5e658633-7d3f-4f3a-a111-7ace539f78b1 req-a735e435-b515-4311-9285-612c8bc5f3cd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074918 Jun 25 16:09:49.590327 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 215/433] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 16:09:49.716147 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6840b488-c0f5-4a60-a7e1-f7ad63e681e4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:49.724557 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6840b488-c0f5-4a60-a7e1-f7ad63e681e4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:49.726114 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6840b488-c0f5-4a60-a7e1-f7ad63e681e4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:49.727431 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6840b488-c0f5-4a60-a7e1-f7ad63e681e4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1739 microversion: 2.20 time: 0.179119 Jun 25 16:09:49.728226 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 219/434] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:09:49 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 16:09:49.829318 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-018fb7ac-a1bc-47ee-b791-a806829ecd83 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:49.830301 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-018fb7ac-a1bc-47ee-b791-a806829ecd83 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:49.837310 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-018fb7ac-a1bc-47ee-b791-a806829ecd83 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:49.839627 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-018fb7ac-a1bc-47ee-b791-a806829ecd83 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:49.841531 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-018fb7ac-a1bc-47ee-b791-a806829ecd83 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:49.853138 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-018fb7ac-a1bc-47ee-b791-a806829ecd83 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:50.011582 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-018fb7ac-a1bc-47ee-b791-a806829ecd83 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:50.021156 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-018fb7ac-a1bc-47ee-b791-a806829ecd83 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9" status: 200 len: 1364 microversion: 2.1 time: 0.196078 Jun 25 16:09:50.024437 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 216/435] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:49 2022] GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:50.749781 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e0e86394-cb73-49c4-8491-434ead769959 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:50.750718 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e0e86394-cb73-49c4-8491-434ead769959 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:50.758645 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0e86394-cb73-49c4-8491-434ead769959 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:50.759095 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0e86394-cb73-49c4-8491-434ead769959 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:50.760005 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0e86394-cb73-49c4-8491-434ead769959 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:50.760441 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0e86394-cb73-49c4-8491-434ead769959 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:50.912460 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e0e86394-cb73-49c4-8491-434ead769959 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:50.921080 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e0e86394-cb73-49c4-8491-434ead769959 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:50.923021 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e0e86394-cb73-49c4-8491-434ead769959 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:50.924399 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e0e86394-cb73-49c4-8491-434ead769959 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1739 microversion: 2.20 time: 0.181164 Jun 25 16:09:50.935366 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 220/436] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:09:50 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:09:51.041094 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-e51aeb3c-fd7f-4396-bd4e-436bb18c3ac9 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:51.042318 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-e51aeb3c-fd7f-4396-bd4e-436bb18c3ac9 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:51.049199 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e51aeb3c-fd7f-4396-bd4e-436bb18c3ac9 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:51.049908 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e51aeb3c-fd7f-4396-bd4e-436bb18c3ac9 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:51.050689 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e51aeb3c-fd7f-4396-bd4e-436bb18c3ac9 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:51.051128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e51aeb3c-fd7f-4396-bd4e-436bb18c3ac9 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:51.305114 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-e51aeb3c-fd7f-4396-bd4e-436bb18c3ac9 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:51.313399 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-e51aeb3c-fd7f-4396-bd4e-436bb18c3ac9 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9" status: 200 len: 1364 microversion: 2.1 time: 0.278490 Jun 25 16:09:51.314304 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 217/437] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:51 2022] GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 => generated 1364 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:51.946163 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4ab2f349-5f64-4921-b6fc-eb613bb3600b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:51.946759 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4ab2f349-5f64-4921-b6fc-eb613bb3600b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:51.961658 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4ab2f349-5f64-4921-b6fc-eb613bb3600b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:51.964347 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4ab2f349-5f64-4921-b6fc-eb613bb3600b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:51.965383 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4ab2f349-5f64-4921-b6fc-eb613bb3600b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:51.965822 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4ab2f349-5f64-4921-b6fc-eb613bb3600b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:52.130832 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4ab2f349-5f64-4921-b6fc-eb613bb3600b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:52.140785 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4ab2f349-5f64-4921-b6fc-eb613bb3600b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:52.142482 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4ab2f349-5f64-4921-b6fc-eb613bb3600b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:52.144753 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4ab2f349-5f64-4921-b6fc-eb613bb3600b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1739 microversion: 2.20 time: 0.205321 Jun 25 16:09:52.146056 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 221/438] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:09:51 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1739 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:09:52.332092 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-c8371ff7-8b05-4c3b-bbec-c2d9594320f1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:52.339055 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-c8371ff7-8b05-4c3b-bbec-c2d9594320f1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:52.350275 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-c8371ff7-8b05-4c3b-bbec-c2d9594320f1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:52.351421 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-c8371ff7-8b05-4c3b-bbec-c2d9594320f1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:52.353146 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-c8371ff7-8b05-4c3b-bbec-c2d9594320f1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:52.354131 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-c8371ff7-8b05-4c3b-bbec-c2d9594320f1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:52.566627 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-c8371ff7-8b05-4c3b-bbec-c2d9594320f1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:52.575738 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-c8371ff7-8b05-4c3b-bbec-c2d9594320f1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9" status: 200 len: 1364 microversion: 2.1 time: 0.247548 Jun 25 16:09:52.576701 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 218/439] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:52 2022] GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 => generated 1364 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:53.163966 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c0686ead-ca8b-4775-94f5-a997fca06505 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:53.165477 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c0686ead-ca8b-4775-94f5-a997fca06505 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:53.175022 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c0686ead-ca8b-4775-94f5-a997fca06505 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:53.176869 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c0686ead-ca8b-4775-94f5-a997fca06505 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:53.178099 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c0686ead-ca8b-4775-94f5-a997fca06505 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:53.181305 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c0686ead-ca8b-4775-94f5-a997fca06505 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:53.385186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c0686ead-ca8b-4775-94f5-a997fca06505 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:53.394228 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c0686ead-ca8b-4775-94f5-a997fca06505 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:53.396320 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c0686ead-ca8b-4775-94f5-a997fca06505 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:53.400182 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c0686ead-ca8b-4775-94f5-a997fca06505 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1739 microversion: 2.20 time: 0.240589 Jun 25 16:09:53.401412 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 222/440] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:09:53 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1739 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:09:53.598092 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-a90493a2-5e5c-411c-8efd-30beb1d5e895 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:53.600081 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-a90493a2-5e5c-411c-8efd-30beb1d5e895 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:53.613115 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a90493a2-5e5c-411c-8efd-30beb1d5e895 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:53.613878 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a90493a2-5e5c-411c-8efd-30beb1d5e895 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:53.615514 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a90493a2-5e5c-411c-8efd-30beb1d5e895 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:53.616244 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a90493a2-5e5c-411c-8efd-30beb1d5e895 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:53.813155 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-a90493a2-5e5c-411c-8efd-30beb1d5e895 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:53.821557 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-a90493a2-5e5c-411c-8efd-30beb1d5e895 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9" status: 200 len: 1364 microversion: 2.1 time: 0.228823 Jun 25 16:09:53.822273 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 219/441] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:53 2022] GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 => generated 1364 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:54.261223 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2960d094-84cc-4e2e-818f-26acfb628c2f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:09:54.262844 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2960d094-84cc-4e2e-818f-26acfb628c2f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:54.274782 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:09:54.275807 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=6 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:09:54.278455 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2960d094-84cc-4e2e-818f-26acfb628c2f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:54.279196 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2960d094-84cc-4e2e-818f-26acfb628c2f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:54.280613 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2960d094-84cc-4e2e-818f-26acfb628c2f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:54.281371 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2960d094-84cc-4e2e-818f-26acfb628c2f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:54.327004 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-2960d094-84cc-4e2e-818f-26acfb628c2f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lazy-loading 'flavor' on Instance uuid 8de27285-8f18-4d98-b240-0042e68f7ff9 {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 16:09:54.422519 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-8091c34c-105f-4bd9-bf80-f3a865cdce64 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:54.423144 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-8091c34c-105f-4bd9-bf80-f3a865cdce64 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:54.425464 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell0:SELECT=6 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:09:54.436709 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8091c34c-105f-4bd9-bf80-f3a865cdce64 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:54.437166 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8091c34c-105f-4bd9-bf80-f3a865cdce64 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:54.437946 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8091c34c-105f-4bd9-bf80-f3a865cdce64 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:54.438558 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8091c34c-105f-4bd9-bf80-f3a865cdce64 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:54.530357 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2960d094-84cc-4e2e-818f-26acfb628c2f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "POST /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9/action" status: 200 len: 32 microversion: 2.1 time: 0.273801 Jun 25 16:09:54.537500 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 223/442] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Jun 25 16:09:54 2022] POST /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9/action => generated 32 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 16:09:54.543999 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-00b585d7-1ef8-4916-a316-c74df94f87bf tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:54.551096 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-00b585d7-1ef8-4916-a316-c74df94f87bf tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:54.563292 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-00b585d7-1ef8-4916-a316-c74df94f87bf tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:54.564222 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-00b585d7-1ef8-4916-a316-c74df94f87bf tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:54.565326 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-00b585d7-1ef8-4916-a316-c74df94f87bf tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:54.566291 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-00b585d7-1ef8-4916-a316-c74df94f87bf tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:54.821262 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-8091c34c-105f-4bd9-bf80-f3a865cdce64 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:54.834189 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-8091c34c-105f-4bd9-bf80-f3a865cdce64 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:54.837628 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-8091c34c-105f-4bd9-bf80-f3a865cdce64 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:54.839388 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-8091c34c-105f-4bd9-bf80-f3a865cdce64 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1739 microversion: 2.20 time: 0.422775 Jun 25 16:09:54.841434 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 220/443] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:09:54 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1739 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:09:54.848373 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-3f5dc12c-b2c7-4d8d-bcb8-63805901d8bf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:54.849229 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-3f5dc12c-b2c7-4d8d-bcb8-63805901d8bf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:54.857324 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3f5dc12c-b2c7-4d8d-bcb8-63805901d8bf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:54.858658 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3f5dc12c-b2c7-4d8d-bcb8-63805901d8bf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:54.859597 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3f5dc12c-b2c7-4d8d-bcb8-63805901d8bf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:54.860991 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3f5dc12c-b2c7-4d8d-bcb8-63805901d8bf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:54.987287 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-00b585d7-1ef8-4916-a316-c74df94f87bf tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:54.991664 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:09:54.997835 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-00b585d7-1ef8-4916-a316-c74df94f87bf tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1733 microversion: 2.1 time: 0.458698 Jun 25 16:09:55.011595 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 224/444] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:54 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1733 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:55.118649 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-3f5dc12c-b2c7-4d8d-bcb8-63805901d8bf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:55.133740 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-3f5dc12c-b2c7-4d8d-bcb8-63805901d8bf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9" status: 200 len: 1364 microversion: 2.1 time: 0.290626 Jun 25 16:09:55.136914 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 221/445] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:54 2022] GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 => generated 1364 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:55.758550 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6b856221-a238-4a5a-88ad-de2bc256c66e tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:55.759196 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6b856221-a238-4a5a-88ad-de2bc256c66e tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 41fc3e49-00d7-473e-8aff-17796e05c84b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:55.771996 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6b856221-a238-4a5a-88ad-de2bc256c66e tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:55.772498 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6b856221-a238-4a5a-88ad-de2bc256c66e tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:55.773268 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6b856221-a238-4a5a-88ad-de2bc256c66e tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:55.776437 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6b856221-a238-4a5a-88ad-de2bc256c66e tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:55.884206 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-c592d095-508a-4cee-9300-2f851ea64ffd tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:55.887011 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-c592d095-508a-4cee-9300-2f851ea64ffd tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:55.897328 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-c592d095-508a-4cee-9300-2f851ea64ffd tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:55.897782 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-c592d095-508a-4cee-9300-2f851ea64ffd tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:55.898556 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-c592d095-508a-4cee-9300-2f851ea64ffd tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:55.898989 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-c592d095-508a-4cee-9300-2f851ea64ffd tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:55.969743 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-6b856221-a238-4a5a-88ad-de2bc256c66e tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lazy-loading 'services' on Instance uuid 41fc3e49-00d7-473e-8aff-17796e05c84b {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 16:09:56.130876 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6b856221-a238-4a5a-88ad-de2bc256c66e tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "DELETE /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b/os-volume_attachments/5d92dbb1-67cd-49c2-ab1a-f8171293b4a0" status: 202 len: 0 microversion: 2.1 time: 0.384587 Jun 25 16:09:56.133574 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 225/446] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Jun 25 16:09:55 2022] DELETE /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b/os-volume_attachments/5d92dbb1-67cd-49c2-ab1a-f8171293b4a0 => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 16:09:56.142144 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-c592d095-508a-4cee-9300-2f851ea64ffd tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:56.143759 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-07647036-ba62-4764-8120-ac95450498a6 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:56.146225 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-07647036-ba62-4764-8120-ac95450498a6 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:56.160430 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-c592d095-508a-4cee-9300-2f851ea64ffd tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:56.163838 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-c592d095-508a-4cee-9300-2f851ea64ffd tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:56.166308 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-c592d095-508a-4cee-9300-2f851ea64ffd tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1739 microversion: 2.20 time: 0.295582 Jun 25 16:09:56.166440 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-07647036-ba62-4764-8120-ac95450498a6 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:56.166875 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-07647036-ba62-4764-8120-ac95450498a6 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:56.167660 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-07647036-ba62-4764-8120-ac95450498a6 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:56.168547 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-07647036-ba62-4764-8120-ac95450498a6 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:56.169686 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 222/447] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:09:55 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1739 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:09:56.179001 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-ccc84046-8ec2-4314-97bd-4505ba4e1816 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:56.179965 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-ccc84046-8ec2-4314-97bd-4505ba4e1816 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:56.209843 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ccc84046-8ec2-4314-97bd-4505ba4e1816 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:56.210497 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ccc84046-8ec2-4314-97bd-4505ba4e1816 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:56.213170 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ccc84046-8ec2-4314-97bd-4505ba4e1816 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:56.214032 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ccc84046-8ec2-4314-97bd-4505ba4e1816 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:56.692028 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-07647036-ba62-4764-8120-ac95450498a6 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:56.703537 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-07647036-ba62-4764-8120-ac95450498a6 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1733 microversion: 2.1 time: 0.567809 Jun 25 16:09:56.717156 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-ccc84046-8ec2-4314-97bd-4505ba4e1816 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:56.718591 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 226/448] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:56 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1733 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:56.726067 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-ccc84046-8ec2-4314-97bd-4505ba4e1816 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9" status: 200 len: 1364 microversion: 2.1 time: 0.554252 Jun 25 16:09:56.726678 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 223/449] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:56 2022] GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 => generated 1364 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:57.192079 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-45689e62-8b2a-430b-b7e4-918712fb7fe6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:57.193152 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-45689e62-8b2a-430b-b7e4-918712fb7fe6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:57.201680 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-45689e62-8b2a-430b-b7e4-918712fb7fe6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:57.202370 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-45689e62-8b2a-430b-b7e4-918712fb7fe6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:57.203305 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-45689e62-8b2a-430b-b7e4-918712fb7fe6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:57.204088 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-45689e62-8b2a-430b-b7e4-918712fb7fe6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:57.346617 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-ceab38a0-c600-48fd-b256-a9dba1a8ef9f tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:57.347948 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-ceab38a0-c600-48fd-b256-a9dba1a8ef9f tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 41fc3e49-00d7-473e-8aff-17796e05c84b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:57.374936 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ceab38a0-c600-48fd-b256-a9dba1a8ef9f tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:57.375316 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ceab38a0-c600-48fd-b256-a9dba1a8ef9f tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:57.383986 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ceab38a0-c600-48fd-b256-a9dba1a8ef9f tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:57.384660 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ceab38a0-c600-48fd-b256-a9dba1a8ef9f tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:57.393093 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-45689e62-8b2a-430b-b7e4-918712fb7fe6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:57.402826 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-45689e62-8b2a-430b-b7e4-918712fb7fe6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:57.405636 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-45689e62-8b2a-430b-b7e4-918712fb7fe6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:57.407167 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-45689e62-8b2a-430b-b7e4-918712fb7fe6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1739 microversion: 2.20 time: 0.219666 Jun 25 16:09:57.408334 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 227/450] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:09:57 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 16:09:57.413285 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-8bae6dc7-6cc5-427f-b61e-606a5843f5b7 req-d82e5076-52b6-4c5a-9f50-e3f0bfdcdf92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9", "name": "network-vif-plugged", "status": "completed", "tag": "c9f4f158-6c65-4bbe-8425-f8fcb9a31e68"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:09:57.423266 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-8bae6dc7-6cc5-427f-b61e-606a5843f5b7 req-d82e5076-52b6-4c5a-9f50-e3f0bfdcdf92 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:57.424362 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-8bae6dc7-6cc5-427f-b61e-606a5843f5b7 req-d82e5076-52b6-4c5a-9f50-e3f0bfdcdf92 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:57.433868 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-ceab38a0-c600-48fd-b256-a9dba1a8ef9f tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 41fc3e49-00d7-473e-8aff-17796e05c84b] Going to try to terminate instance {{(pid=117794) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 16:09:57.459544 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-8bae6dc7-6cc5-427f-b61e-606a5843f5b7 req-d82e5076-52b6-4c5a-9f50-e3f0bfdcdf92 service nova] Creating event network-vif-plugged:c9f4f158-6c65-4bbe-8425-f8fcb9a31e68 for instance b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 on hv-cinder-84762 Jun 25 16:09:57.471991 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-8bae6dc7-6cc5-427f-b61e-606a5843f5b7 req-d82e5076-52b6-4c5a-9f50-e3f0bfdcdf92 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059983 Jun 25 16:09:57.472833 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 228/451] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:09:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:09:57.553144 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-ceab38a0-c600-48fd-b256-a9dba1a8ef9f tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "DELETE /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b" status: 204 len: 0 microversion: 2.1 time: 0.209927 Jun 25 16:09:57.553928 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 224/452] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Jun 25 16:09:57 2022] DELETE /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 25 16:09:57.563703 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-66077f44-b99d-4982-8308-3e9002fc1a5d tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:57.564373 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-66077f44-b99d-4982-8308-3e9002fc1a5d tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 41fc3e49-00d7-473e-8aff-17796e05c84b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:57.573809 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-66077f44-b99d-4982-8308-3e9002fc1a5d tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:57.574260 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-66077f44-b99d-4982-8308-3e9002fc1a5d tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:57.575197 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-66077f44-b99d-4982-8308-3e9002fc1a5d tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:57.575802 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-66077f44-b99d-4982-8308-3e9002fc1a5d tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:57.726044 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-5494fa73-303b-4a15-83cd-fa022525241e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:57.726861 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-5494fa73-303b-4a15-83cd-fa022525241e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:57.734243 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5494fa73-303b-4a15-83cd-fa022525241e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:57.734972 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5494fa73-303b-4a15-83cd-fa022525241e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:57.740455 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5494fa73-303b-4a15-83cd-fa022525241e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:57.743441 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5494fa73-303b-4a15-83cd-fa022525241e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:57.748782 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-66077f44-b99d-4982-8308-3e9002fc1a5d tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:57.757140 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-66077f44-b99d-4982-8308-3e9002fc1a5d tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b" status: 200 len: 1514 microversion: 2.1 time: 0.198060 Jun 25 16:09:57.776449 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 229/453] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:57 2022] GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b => generated 1514 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:57.782426 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-73b920e5-0922-489a-b4e5-32aa389f8436 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:57.783042 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-73b920e5-0922-489a-b4e5-32aa389f8436 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:57.793803 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-73b920e5-0922-489a-b4e5-32aa389f8436 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:57.794278 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-73b920e5-0922-489a-b4e5-32aa389f8436 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:57.795058 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-73b920e5-0922-489a-b4e5-32aa389f8436 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:57.795487 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-73b920e5-0922-489a-b4e5-32aa389f8436 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:57.974747 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-5494fa73-303b-4a15-83cd-fa022525241e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:57.978399 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:09:57.983409 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-5494fa73-303b-4a15-83cd-fa022525241e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1733 microversion: 2.1 time: 0.262746 Jun 25 16:09:57.984187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 225/454] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:57 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1733 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:57.997686 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-73b920e5-0922-489a-b4e5-32aa389f8436 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:58.005181 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-73b920e5-0922-489a-b4e5-32aa389f8436 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9" status: 200 len: 1364 microversion: 2.1 time: 0.227861 Jun 25 16:09:58.005741 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 230/455] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:57 2022] GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:58.431180 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-921d5e12-8d38-4e2b-9d97-a69c129773f3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:58.432186 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-921d5e12-8d38-4e2b-9d97-a69c129773f3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:58.442518 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-921d5e12-8d38-4e2b-9d97-a69c129773f3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:58.442987 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-921d5e12-8d38-4e2b-9d97-a69c129773f3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:58.443734 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-921d5e12-8d38-4e2b-9d97-a69c129773f3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:58.444164 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-921d5e12-8d38-4e2b-9d97-a69c129773f3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:58.581238 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-921d5e12-8d38-4e2b-9d97-a69c129773f3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:58.590651 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-921d5e12-8d38-4e2b-9d97-a69c129773f3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:58.592169 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-921d5e12-8d38-4e2b-9d97-a69c129773f3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:58.593365 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-921d5e12-8d38-4e2b-9d97-a69c129773f3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1739 microversion: 2.20 time: 0.169284 Jun 25 16:09:58.593922 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 226/456] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:09:58 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1739 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:09:58.783091 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-db051599-baee-4d3c-bd42-f051a4679f04 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:58.783963 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-db051599-baee-4d3c-bd42-f051a4679f04 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 41fc3e49-00d7-473e-8aff-17796e05c84b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:58.792514 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-db051599-baee-4d3c-bd42-f051a4679f04 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:58.792514 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-db051599-baee-4d3c-bd42-f051a4679f04 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:58.792514 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-db051599-baee-4d3c-bd42-f051a4679f04 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:58.792779 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-db051599-baee-4d3c-bd42-f051a4679f04 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:58.983114 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-db051599-baee-4d3c-bd42-f051a4679f04 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:58.995483 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-db051599-baee-4d3c-bd42-f051a4679f04 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b" status: 200 len: 1514 microversion: 2.1 time: 0.216232 Jun 25 16:09:58.998902 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 231/457] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:58 2022] GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b => generated 1514 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:59.001786 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-fbd2aa8c-ed92-4da1-af0b-00d1ac62c7a2 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:59.002485 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-fbd2aa8c-ed92-4da1-af0b-00d1ac62c7a2 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:59.008866 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-fbd2aa8c-ed92-4da1-af0b-00d1ac62c7a2 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:59.009341 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-fbd2aa8c-ed92-4da1-af0b-00d1ac62c7a2 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:59.010148 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-fbd2aa8c-ed92-4da1-af0b-00d1ac62c7a2 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:59.010589 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-fbd2aa8c-ed92-4da1-af0b-00d1ac62c7a2 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:59.022457 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2783f3d3-5461-4f37-8439-b312ecdf0687 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:59.023107 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2783f3d3-5461-4f37-8439-b312ecdf0687 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:59.029636 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2783f3d3-5461-4f37-8439-b312ecdf0687 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:59.030108 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2783f3d3-5461-4f37-8439-b312ecdf0687 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:59.030869 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2783f3d3-5461-4f37-8439-b312ecdf0687 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:59.031357 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2783f3d3-5461-4f37-8439-b312ecdf0687 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:59.247635 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-fbd2aa8c-ed92-4da1-af0b-00d1ac62c7a2 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:59.256444 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-fbd2aa8c-ed92-4da1-af0b-00d1ac62c7a2 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1733 microversion: 2.1 time: 0.258578 Jun 25 16:09:59.257258 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 227/458] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:58 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1733 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:59.265038 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2783f3d3-5461-4f37-8439-b312ecdf0687 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:59.273038 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2783f3d3-5461-4f37-8439-b312ecdf0687 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9" status: 200 len: 1364 microversion: 2.1 time: 0.254492 Jun 25 16:09:59.273535 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 232/459] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:09:59 2022] GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 => generated 1364 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:09:59.611942 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-29486d87-7373-44c4-bf21-866921ab5c8d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:09:59.614040 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-29486d87-7373-44c4-bf21-866921ab5c8d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:09:59.621881 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-29486d87-7373-44c4-bf21-866921ab5c8d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:59.622639 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-29486d87-7373-44c4-bf21-866921ab5c8d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:59.623754 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-29486d87-7373-44c4-bf21-866921ab5c8d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:09:59.624331 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-29486d87-7373-44c4-bf21-866921ab5c8d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:09:59.861361 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-29486d87-7373-44c4-bf21-866921ab5c8d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:59.871337 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-29486d87-7373-44c4-bf21-866921ab5c8d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:59.873062 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-29486d87-7373-44c4-bf21-866921ab5c8d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:09:59.874274 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-29486d87-7373-44c4-bf21-866921ab5c8d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1721 microversion: 2.20 time: 0.266345 Jun 25 16:09:59.886267 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 228/460] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:09:59 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1721 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:10:00.019989 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e893af20-4bf2-466b-a00f-108b5a5ba299 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:00.021390 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e893af20-4bf2-466b-a00f-108b5a5ba299 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 41fc3e49-00d7-473e-8aff-17796e05c84b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:00.029589 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e893af20-4bf2-466b-a00f-108b5a5ba299 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:00.030456 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e893af20-4bf2-466b-a00f-108b5a5ba299 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:00.031382 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e893af20-4bf2-466b-a00f-108b5a5ba299 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:00.031971 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e893af20-4bf2-466b-a00f-108b5a5ba299 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:00.241596 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-f66b9001-3e40-455f-949d-97b0678d0b1b req-9e410f5b-8ecc-4543-ba81-4c9a46cb2dca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41fc3e49-00d7-473e-8aff-17796e05c84b", "name": "network-vif-deleted", "tag": "43551aa5-c58d-4fa4-ab62-60938bf7595a"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:10:00.267094 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-f66b9001-3e40-455f-949d-97b0678d0b1b req-9e410f5b-8ecc-4543-ba81-4c9a46cb2dca service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:00.267968 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-f66b9001-3e40-455f-949d-97b0678d0b1b req-9e410f5b-8ecc-4543-ba81-4c9a46cb2dca service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:00.280250 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e893af20-4bf2-466b-a00f-108b5a5ba299 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf0332a9562946169ff8a45bf5e6f6f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e1e0c6b3e544d138a1c7911cf155076', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:00.286904 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-f66b9001-3e40-455f-949d-97b0678d0b1b req-9e410f5b-8ecc-4543-ba81-4c9a46cb2dca service nova] Creating event network-vif-deleted:43551aa5-c58d-4fa4-ab62-60938bf7595a for instance 41fc3e49-00d7-473e-8aff-17796e05c84b on hv-cinder-84762 Jun 25 16:10:00.289365 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e893af20-4bf2-466b-a00f-108b5a5ba299 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b" status: 200 len: 1514 microversion: 2.1 time: 0.278958 Jun 25 16:10:00.289950 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 233/461] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:10:00 2022] GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b => generated 1514 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:10:00.293820 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-f66b9001-3e40-455f-949d-97b0678d0b1b req-9e410f5b-8ecc-4543-ba81-4c9a46cb2dca service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056059 Jun 25 16:10:00.295052 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-345042e7-473b-4092-8d3f-833e401e5471 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:00.295440 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 229/462] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:10:00.295796 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-345042e7-473b-4092-8d3f-833e401e5471 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:00.302506 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-345042e7-473b-4092-8d3f-833e401e5471 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:00.302761 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-9bfe36aa-f330-4b4e-b829-0fd0a4b63e20 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:00.302971 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-345042e7-473b-4092-8d3f-833e401e5471 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:00.303695 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-9bfe36aa-f330-4b4e-b829-0fd0a4b63e20 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:00.303824 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-345042e7-473b-4092-8d3f-833e401e5471 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:00.304155 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-345042e7-473b-4092-8d3f-833e401e5471 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:00.310208 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9bfe36aa-f330-4b4e-b829-0fd0a4b63e20 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:00.310661 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9bfe36aa-f330-4b4e-b829-0fd0a4b63e20 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:00.311526 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9bfe36aa-f330-4b4e-b829-0fd0a4b63e20 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:00.312050 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9bfe36aa-f330-4b4e-b829-0fd0a4b63e20 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:00.506342 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-345042e7-473b-4092-8d3f-833e401e5471 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:00.510891 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-9bfe36aa-f330-4b4e-b829-0fd0a4b63e20 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:00.515067 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-345042e7-473b-4092-8d3f-833e401e5471 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1733 microversion: 2.1 time: 0.223599 Jun 25 16:10:00.515643 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 234/463] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:10:00 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1733 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:10:00.519110 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-9bfe36aa-f330-4b4e-b829-0fd0a4b63e20 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9" status: 200 len: 1364 microversion: 2.1 time: 0.221889 Jun 25 16:10:00.519769 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 230/464] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:10:00 2022] GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 => generated 1364 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:10:00.894765 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-0540ae4c-fb59-4473-b6e9-4fef32d28b2b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:00.895372 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0540ae4c-fb59-4473-b6e9-4fef32d28b2b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:00.901640 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0540ae4c-fb59-4473-b6e9-4fef32d28b2b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:00.902095 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0540ae4c-fb59-4473-b6e9-4fef32d28b2b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:00.902860 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0540ae4c-fb59-4473-b6e9-4fef32d28b2b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:00.903298 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0540ae4c-fb59-4473-b6e9-4fef32d28b2b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:01.040783 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-0540ae4c-fb59-4473-b6e9-4fef32d28b2b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:01.049046 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-0540ae4c-fb59-4473-b6e9-4fef32d28b2b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:01.050786 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-0540ae4c-fb59-4473-b6e9-4fef32d28b2b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:01.051717 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-0540ae4c-fb59-4473-b6e9-4fef32d28b2b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1721 microversion: 2.20 time: 0.162012 Jun 25 16:10:01.052253 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 235/465] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:10:00 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:10:01.305909 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-fb31e85f-fc7b-4d44-9a36-e7d6114b4c29 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:01.306612 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-fb31e85f-fc7b-4d44-9a36-e7d6114b4c29 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] [instance: 41fc3e49-00d7-473e-8aff-17796e05c84b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:01.313662 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-fb31e85f-fc7b-4d44-9a36-e7d6114b4c29 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:01.314185 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-fb31e85f-fc7b-4d44-9a36-e7d6114b4c29 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:01.315072 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-fb31e85f-fc7b-4d44-9a36-e7d6114b4c29 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:01.315590 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-fb31e85f-fc7b-4d44-9a36-e7d6114b4c29 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:01.329210 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.wsgi [None req-fb31e85f-fc7b-4d44-9a36-e7d6114b4c29 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] HTTP exception thrown: Instance 41fc3e49-00d7-473e-8aff-17796e05c84b could not be found. Jun 25 16:10:01.331093 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-fb31e85f-fc7b-4d44-9a36-e7d6114b4c29 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Request method failure captured: Jun 25 16:10:01.331093 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: request: GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b HTTP/1.1 Jun 25 16:10:01.331093 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept: application/json Jun 25 16:10:01.331093 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept-Encoding: identity Jun 25 16:10:01.331093 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Connection: close Jun 25 16:10:01.331093 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Length: 0 Jun 25 16:10:01.331093 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Type: application/json Jun 25 16:10:01.331093 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Host: 10.222.0.13 Jun 25 16:10:01.331093 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Openstack-System-Scope: None Jun 25 16:10:01.331093 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: User-Agent: python-urllib3/1.26.9 Jun 25 16:10:01.331093 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Auth-Token: gAAAAABitzLUccvPVi2pB58jWe4zbKzEH36lEkhaDRyyFHsw072Z-M5CvfcZT-sAsFpamysxmhebXdMjYv1cdF0cdKc5ZBXilPbIea0OJIEYpdHm9xeGKIYOP7g5985XD-7gRJ-SVRcOULxM1S8D-uPXaRJmn9bBwIbEC-ys027ZRHpwW_3iqGk Jun 25 16:10:01.331093 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Id: None Jun 25 16:10:01.331093 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Name: None Jun 25 16:10:01.331093 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Identity-Status: Confirmed Jun 25 16:10:01.331093 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Is-Admin-Project: True Jun 25 16:10:01.331093 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Id: default Jun 25 16:10:01.331093 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Name: Default Jun 25 16:10:01.331093 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Id: 4e1e0c6b3e544d138a1c7911cf155076 Jun 25 16:10:01.331093 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Name: tempest-VolumesSnapshotTestJSON-520792287 Jun 25 16:10:01.331093 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Role: reader,member Jun 25 16:10:01.331093 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Roles: reader,member Jun 25 16:10:01.332661 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4e1e0c6b3e544d138a1c7911cf155076"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4e1e0c6b3e544d138a1c7911cf155076"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4e1e0c6b3e544d138a1c7911cf155076", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4e1e0c6b3e544d138a1c7911cf155076"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:10:01.332661 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant: tempest-VolumesSnapshotTestJSON-520792287 Jun 25 16:10:01.332661 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Id: 4e1e0c6b3e544d138a1c7911cf155076 Jun 25 16:10:01.332661 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-520792287 Jun 25 16:10:01.332661 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User: tempest-VolumesSnapshotTestJSON-520792287-project Jun 25 16:10:01.332661 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Id: default Jun 25 16:10:01.332661 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Name: Default Jun 25 16:10:01.332661 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Id: bf0332a9562946169ff8a45bf5e6f6f3 Jun 25 16:10:01.332661 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Name: tempest-VolumesSnapshotTestJSON-520792287-project Jun 25 16:10:01.332661 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: method: > Jun 25 16:10:01.332661 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: exception: Instance 41fc3e49-00d7-473e-8aff-17796e05c84b could not be found. Jun 25 16:10:01.332661 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: action_args: {'id': '41fc3e49-00d7-473e-8aff-17796e05c84b'} Jun 25 16:10:01.333662 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:10:01.333662 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:10:01.333662 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:10:01.333662 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:10:01.333662 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:10:01.333662 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:10:01.333662 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:10:01.333662 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:10:01.333662 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:10:01.333662 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:10:01.333662 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41fc3e49-00d7-473e-8aff-17796e05c84b could not be found. Jun 25 16:10:01.333662 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:10:01.333662 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:10:01.333662 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:10:01.333662 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:10:01.333662 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:10:01.333662 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:10:01.333662 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:10:01.333662 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:10:01.333662 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:10:01.334979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:10:01.334979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 16:10:01.334979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 16:10:01.334979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:10:01.334979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:10:01.334979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:10:01.334979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:10:01.334979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41fc3e49-00d7-473e-8aff-17796e05c84b could not be found. Jun 25 16:10:01.334979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:10:01.334979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:10:01.334979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:10:01.334979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:10:01.334979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:10:01.334979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:10:01.334979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:10:01.334979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:10:01.334979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41fc3e49-00d7-473e-8aff-17796e05c84b could not be found. Jun 25 16:10:01.334979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:10:01.337200 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-fb31e85f-fc7b-4d44-9a36-e7d6114b4c29 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] Returning 404 to user: Instance 41fc3e49-00d7-473e-8aff-17796e05c84b could not be found. {{(pid=117794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:10:01.337200 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-fb31e85f-fc7b-4d44-9a36-e7d6114b4c29 tempest-VolumesSnapshotTestJSON-520792287 tempest-VolumesSnapshotTestJSON-520792287-project] 10.222.0.13 "GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b" status: 404 len: 111 microversion: 2.1 time: 0.030540 Jun 25 16:10:01.337200 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 231/466] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:10:01 2022] GET /compute/v2.1/servers/41fc3e49-00d7-473e-8aff-17796e05c84b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:10:01.533675 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ba117789-96eb-4756-9091-7b52167473c1 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:01.534660 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ba117789-96eb-4756-9091-7b52167473c1 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:01.538501 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-4747354f-e451-43ec-b4e4-59086c4cc1bf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:01.539082 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-4747354f-e451-43ec-b4e4-59086c4cc1bf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:01.542290 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ba117789-96eb-4756-9091-7b52167473c1 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:01.543190 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ba117789-96eb-4756-9091-7b52167473c1 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:01.544206 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ba117789-96eb-4756-9091-7b52167473c1 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:01.544693 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ba117789-96eb-4756-9091-7b52167473c1 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:01.547062 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4747354f-e451-43ec-b4e4-59086c4cc1bf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:01.547590 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4747354f-e451-43ec-b4e4-59086c4cc1bf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:01.548712 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4747354f-e451-43ec-b4e4-59086c4cc1bf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:01.549225 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4747354f-e451-43ec-b4e4-59086c4cc1bf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:01.765243 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-4747354f-e451-43ec-b4e4-59086c4cc1bf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:01.769597 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ba117789-96eb-4756-9091-7b52167473c1 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:01.782345 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-4747354f-e451-43ec-b4e4-59086c4cc1bf tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9" status: 200 len: 1554 microversion: 2.1 time: 0.249703 Jun 25 16:10:01.782554 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ba117789-96eb-4756-9091-7b52167473c1 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1733 microversion: 2.1 time: 0.253947 Jun 25 16:10:01.783410 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 236/467] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:10:01 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1733 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:10:01.793990 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 232/468] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:10:01 2022] GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 => generated 1554 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:10:01.798815 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-845f794f-c491-44de-8b19-ef2016d486ef tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:01.799752 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-845f794f-c491-44de-8b19-ef2016d486ef tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:01.806540 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-845f794f-c491-44de-8b19-ef2016d486ef tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:01.806868 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-845f794f-c491-44de-8b19-ef2016d486ef tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:01.807623 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-845f794f-c491-44de-8b19-ef2016d486ef tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:01.808047 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-845f794f-c491-44de-8b19-ef2016d486ef tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:01.894009 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-845f794f-c491-44de-8b19-ef2016d486ef tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098871 Jun 25 16:10:01.894636 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 237/469] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Jun 25 16:10:01 2022] GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:10:02.069738 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-f245d29a-00e5-4a7b-b018-bdf3d57e879b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:02.070363 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-f245d29a-00e5-4a7b-b018-bdf3d57e879b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:02.076828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f245d29a-00e5-4a7b-b018-bdf3d57e879b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:02.077422 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f245d29a-00e5-4a7b-b018-bdf3d57e879b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:02.078195 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f245d29a-00e5-4a7b-b018-bdf3d57e879b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:02.078601 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f245d29a-00e5-4a7b-b018-bdf3d57e879b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:02.327846 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-f245d29a-00e5-4a7b-b018-bdf3d57e879b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:02.336376 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-f245d29a-00e5-4a7b-b018-bdf3d57e879b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:02.337950 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-f245d29a-00e5-4a7b-b018-bdf3d57e879b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:02.339114 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-f245d29a-00e5-4a7b-b018-bdf3d57e879b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1721 microversion: 2.20 time: 0.273481 Jun 25 16:10:02.349723 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 233/470] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:10:02 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1721 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:10:02.800914 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1ffa5e15-5e46-4440-adef-73e9155862b7 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:02.801502 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1ffa5e15-5e46-4440-adef-73e9155862b7 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:02.808401 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1ffa5e15-5e46-4440-adef-73e9155862b7 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:02.808888 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1ffa5e15-5e46-4440-adef-73e9155862b7 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:02.809687 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1ffa5e15-5e46-4440-adef-73e9155862b7 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:02.810166 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1ffa5e15-5e46-4440-adef-73e9155862b7 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:03.013009 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-58943ef7-a4f3-419e-baba-db78d5dd565c req-935f4ab7-2080-4fdb-93fc-db0a865e2ea2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9", "tag": "c9f4f158-6c65-4bbe-8425-f8fcb9a31e68"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:10:03.021467 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-58943ef7-a4f3-419e-baba-db78d5dd565c req-935f4ab7-2080-4fdb-93fc-db0a865e2ea2 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:03.021920 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-58943ef7-a4f3-419e-baba-db78d5dd565c req-935f4ab7-2080-4fdb-93fc-db0a865e2ea2 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:03.025567 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1ffa5e15-5e46-4440-adef-73e9155862b7 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:03.033550 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-58943ef7-a4f3-419e-baba-db78d5dd565c req-935f4ab7-2080-4fdb-93fc-db0a865e2ea2 service nova] Creating event network-changed:c9f4f158-6c65-4bbe-8425-f8fcb9a31e68 for instance b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 on hv-cinder-84762 Jun 25 16:10:03.033909 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1ffa5e15-5e46-4440-adef-73e9155862b7 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1733 microversion: 2.1 time: 0.237403 Jun 25 16:10:03.034679 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 238/471] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:10:02 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1733 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:10:03.038508 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-58943ef7-a4f3-419e-baba-db78d5dd565c req-935f4ab7-2080-4fdb-93fc-db0a865e2ea2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029234 Jun 25 16:10:03.039086 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 234/472] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 16:10:03.357576 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d89d8f1b-719d-4070-a10c-2c13973487c9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:03.358813 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d89d8f1b-719d-4070-a10c-2c13973487c9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:03.360937 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:10:03.368687 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d89d8f1b-719d-4070-a10c-2c13973487c9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:03.369286 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d89d8f1b-719d-4070-a10c-2c13973487c9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:03.370427 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d89d8f1b-719d-4070-a10c-2c13973487c9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:03.371061 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d89d8f1b-719d-4070-a10c-2c13973487c9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:03.510254 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d89d8f1b-719d-4070-a10c-2c13973487c9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:03.518960 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d89d8f1b-719d-4070-a10c-2c13973487c9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:03.520515 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d89d8f1b-719d-4070-a10c-2c13973487c9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:03.521677 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d89d8f1b-719d-4070-a10c-2c13973487c9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1721 microversion: 2.20 time: 0.168091 Jun 25 16:10:03.522269 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 239/473] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:10:03 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:10:03.952530 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-e608ba0c-e7c9-4e15-9ffc-a67c31f255df req-279d7360-316f-4394-85bf-ba108541f9f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6ae5a58-db83-401e-a158-ebf0981e84ec", "name": "network-vif-unplugged", "status": "completed", "tag": "3115b4bc-8a8e-494e-90f7-66772013aaf5"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:10:03.961551 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-e608ba0c-e7c9-4e15-9ffc-a67c31f255df req-279d7360-316f-4394-85bf-ba108541f9f3 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:03.962065 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-e608ba0c-e7c9-4e15-9ffc-a67c31f255df req-279d7360-316f-4394-85bf-ba108541f9f3 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:03.974279 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-e608ba0c-e7c9-4e15-9ffc-a67c31f255df req-279d7360-316f-4394-85bf-ba108541f9f3 service nova] Creating event network-vif-unplugged:3115b4bc-8a8e-494e-90f7-66772013aaf5 for instance e6ae5a58-db83-401e-a158-ebf0981e84ec on hv-cinder-84762 Jun 25 16:10:03.979488 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-e608ba0c-e7c9-4e15-9ffc-a67c31f255df req-279d7360-316f-4394-85bf-ba108541f9f3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031532 Jun 25 16:10:03.980432 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 235/474] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:10:04.051290 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-123988c0-6501-4eb1-80de-83c153f947dd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:04.051888 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-123988c0-6501-4eb1-80de-83c153f947dd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:04.058809 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-123988c0-6501-4eb1-80de-83c153f947dd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:04.059300 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-123988c0-6501-4eb1-80de-83c153f947dd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:04.060111 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-123988c0-6501-4eb1-80de-83c153f947dd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:04.060585 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-123988c0-6501-4eb1-80de-83c153f947dd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:04.194683 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-123988c0-6501-4eb1-80de-83c153f947dd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:04.203063 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-123988c0-6501-4eb1-80de-83c153f947dd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1733 microversion: 2.1 time: 0.155762 Jun 25 16:10:04.203637 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 240/475] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:10:04 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:10:04.544284 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-44596fdf-a55c-4755-906a-434cfa78229e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:04.545332 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-44596fdf-a55c-4755-906a-434cfa78229e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:04.553580 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-44596fdf-a55c-4755-906a-434cfa78229e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:04.554060 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-44596fdf-a55c-4755-906a-434cfa78229e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:04.554849 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-44596fdf-a55c-4755-906a-434cfa78229e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:04.555353 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-44596fdf-a55c-4755-906a-434cfa78229e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:04.690526 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-44596fdf-a55c-4755-906a-434cfa78229e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:04.700268 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-44596fdf-a55c-4755-906a-434cfa78229e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:04.701778 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-44596fdf-a55c-4755-906a-434cfa78229e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:04.702949 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-44596fdf-a55c-4755-906a-434cfa78229e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1721 microversion: 2.20 time: 0.165953 Jun 25 16:10:04.703491 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 236/476] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:10:04 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:10:05.223258 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-db7c2504-ea88-41a3-bf88-298c1b73cf1e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:05.223901 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-db7c2504-ea88-41a3-bf88-298c1b73cf1e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:05.230880 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-db7c2504-ea88-41a3-bf88-298c1b73cf1e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:05.231335 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-db7c2504-ea88-41a3-bf88-298c1b73cf1e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:05.232135 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-db7c2504-ea88-41a3-bf88-298c1b73cf1e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:05.232603 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-db7c2504-ea88-41a3-bf88-298c1b73cf1e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:05.370740 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-db7c2504-ea88-41a3-bf88-298c1b73cf1e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:05.374353 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:10:05.380382 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-db7c2504-ea88-41a3-bf88-298c1b73cf1e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1733 microversion: 2.1 time: 0.161114 Jun 25 16:10:05.381836 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 241/477] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:10:05 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:10:05.727196 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-2cd107b0-c326-49fe-9bcc-8a635a80cecc tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:05.727877 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-2cd107b0-c326-49fe-9bcc-8a635a80cecc tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:05.735894 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2cd107b0-c326-49fe-9bcc-8a635a80cecc tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:05.736350 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2cd107b0-c326-49fe-9bcc-8a635a80cecc tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:05.737340 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2cd107b0-c326-49fe-9bcc-8a635a80cecc tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:05.737778 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2cd107b0-c326-49fe-9bcc-8a635a80cecc tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:05.872795 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-2cd107b0-c326-49fe-9bcc-8a635a80cecc tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:05.882948 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-2cd107b0-c326-49fe-9bcc-8a635a80cecc tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:05.884491 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-2cd107b0-c326-49fe-9bcc-8a635a80cecc tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:05.885655 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-2cd107b0-c326-49fe-9bcc-8a635a80cecc tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1724 microversion: 2.20 time: 0.165217 Jun 25 16:10:05.886219 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 237/478] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:10:05 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:10:05.904319 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2aef319f-771b-416e-9c27-49b908853631 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ec22cfe9-2f73-4019-8975-6f7cea545a9a"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:10:05.905464 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2aef319f-771b-416e-9c27-49b908853631 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:05.913468 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2aef319f-771b-416e-9c27-49b908853631 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:05.913953 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2aef319f-771b-416e-9c27-49b908853631 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:05.914723 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2aef319f-771b-416e-9c27-49b908853631 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:05.915160 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2aef319f-771b-416e-9c27-49b908853631 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:06.210928 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2aef319f-771b-416e-9c27-49b908853631 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "POST /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.310596 Jun 25 16:10:06.211529 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 242/479] 10.222.0.13 () {62 vars in 1363 bytes} [Sat Jun 25 16:10:05 2022] POST /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec/os-volume_attachments => generated 188 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 16:10:06.345486 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-5857c533-6d7c-4f3a-97ab-14f8a7d54aa8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:10:06.346173 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-5857c533-6d7c-4f3a-97ab-14f8a7d54aa8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:06.352440 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5857c533-6d7c-4f3a-97ab-14f8a7d54aa8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:06.352923 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5857c533-6d7c-4f3a-97ab-14f8a7d54aa8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:06.353681 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5857c533-6d7c-4f3a-97ab-14f8a7d54aa8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:06.354111 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5857c533-6d7c-4f3a-97ab-14f8a7d54aa8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:06.399117 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-63dfead7-c3a6-453a-8a28-717788376e0e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:06.399808 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-63dfead7-c3a6-453a-8a28-717788376e0e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:06.406974 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-63dfead7-c3a6-453a-8a28-717788376e0e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:06.407500 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-63dfead7-c3a6-453a-8a28-717788376e0e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:06.408838 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-63dfead7-c3a6-453a-8a28-717788376e0e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:06.408979 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-63dfead7-c3a6-453a-8a28-717788376e0e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:06.447589 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-5857c533-6d7c-4f3a-97ab-14f8a7d54aa8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "POST /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec/action" status: 202 len: 0 microversion: 2.20 time: 0.105891 Jun 25 16:10:06.448312 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 238/480] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Jun 25 16:10:06 2022] POST /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 25 16:10:06.456238 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-9ce55e42-bfd6-47fb-b28a-7c43c025bb7f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:06.456884 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-9ce55e42-bfd6-47fb-b28a-7c43c025bb7f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:06.463235 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9ce55e42-bfd6-47fb-b28a-7c43c025bb7f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:06.463694 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9ce55e42-bfd6-47fb-b28a-7c43c025bb7f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:06.464493 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9ce55e42-bfd6-47fb-b28a-7c43c025bb7f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:06.464931 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9ce55e42-bfd6-47fb-b28a-7c43c025bb7f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:06.603718 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-63dfead7-c3a6-453a-8a28-717788376e0e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:06.613427 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-63dfead7-c3a6-453a-8a28-717788376e0e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1733 microversion: 2.1 time: 0.218033 Jun 25 16:10:06.614248 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 243/481] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:10:06 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1733 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:10:06.634038 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-9ce55e42-bfd6-47fb-b28a-7c43c025bb7f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:06.642937 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-9ce55e42-bfd6-47fb-b28a-7c43c025bb7f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:06.644513 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-9ce55e42-bfd6-47fb-b28a-7c43c025bb7f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:06.645630 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-9ce55e42-bfd6-47fb-b28a-7c43c025bb7f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1810 microversion: 2.20 time: 0.193202 Jun 25 16:10:06.646177 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 239/482] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:10:06 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1810 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:10:07.632007 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-0966d99f-6a35-405a-8f69-0e1ce3e01960 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:07.632648 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0966d99f-6a35-405a-8f69-0e1ce3e01960 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:07.639970 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0966d99f-6a35-405a-8f69-0e1ce3e01960 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:07.640479 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0966d99f-6a35-405a-8f69-0e1ce3e01960 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:07.641281 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0966d99f-6a35-405a-8f69-0e1ce3e01960 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:07.641725 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0966d99f-6a35-405a-8f69-0e1ce3e01960 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:07.663152 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-9552e1c4-7b8e-4d5c-b07c-f6f10ddf5a0e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:07.663756 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-9552e1c4-7b8e-4d5c-b07c-f6f10ddf5a0e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:07.670677 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9552e1c4-7b8e-4d5c-b07c-f6f10ddf5a0e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:07.671124 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9552e1c4-7b8e-4d5c-b07c-f6f10ddf5a0e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:07.671914 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9552e1c4-7b8e-4d5c-b07c-f6f10ddf5a0e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:07.672297 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9552e1c4-7b8e-4d5c-b07c-f6f10ddf5a0e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:07.849257 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-0966d99f-6a35-405a-8f69-0e1ce3e01960 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:07.853480 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-9552e1c4-7b8e-4d5c-b07c-f6f10ddf5a0e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:07.858294 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-0966d99f-6a35-405a-8f69-0e1ce3e01960 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1733 microversion: 2.1 time: 0.230519 Jun 25 16:10:07.858845 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 244/483] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:10:07 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1733 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:10:07.863969 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-9552e1c4-7b8e-4d5c-b07c-f6f10ddf5a0e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:07.865558 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-9552e1c4-7b8e-4d5c-b07c-f6f10ddf5a0e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:07.866710 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-9552e1c4-7b8e-4d5c-b07c-f6f10ddf5a0e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1810 microversion: 2.20 time: 0.207433 Jun 25 16:10:07.867224 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 240/484] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:10:07 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1810 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:10:08.876172 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-312172d2-997a-4c7f-bfa3-2b4dcf35cf7c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:08.876853 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-312172d2-997a-4c7f-bfa3-2b4dcf35cf7c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:08.884187 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-312172d2-997a-4c7f-bfa3-2b4dcf35cf7c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:08.885088 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-312172d2-997a-4c7f-bfa3-2b4dcf35cf7c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:08.885885 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-f5e1b5fc-7ef8-4324-9d0c-2c4e87ef2958 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:08.886369 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-312172d2-997a-4c7f-bfa3-2b4dcf35cf7c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:08.886490 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-f5e1b5fc-7ef8-4324-9d0c-2c4e87ef2958 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:08.886653 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-312172d2-997a-4c7f-bfa3-2b4dcf35cf7c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:08.893361 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f5e1b5fc-7ef8-4324-9d0c-2c4e87ef2958 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:08.894085 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f5e1b5fc-7ef8-4324-9d0c-2c4e87ef2958 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:08.894882 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f5e1b5fc-7ef8-4324-9d0c-2c4e87ef2958 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:08.895395 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f5e1b5fc-7ef8-4324-9d0c-2c4e87ef2958 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:09.359958 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-312172d2-997a-4c7f-bfa3-2b4dcf35cf7c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:09.368053 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-f5e1b5fc-7ef8-4324-9d0c-2c4e87ef2958 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:09.369483 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-312172d2-997a-4c7f-bfa3-2b4dcf35cf7c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1733 microversion: 2.1 time: 0.497293 Jun 25 16:10:09.370068 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 245/485] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:10:08 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1733 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:10:09.378339 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-f5e1b5fc-7ef8-4324-9d0c-2c4e87ef2958 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:09.379838 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-f5e1b5fc-7ef8-4324-9d0c-2c4e87ef2958 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:09.381013 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-f5e1b5fc-7ef8-4324-9d0c-2c4e87ef2958 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1752 microversion: 2.20 time: 0.499549 Jun 25 16:10:09.381544 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 241/486] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:10:08 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1752 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 16:10:10.393834 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b43b1104-9a65-4cf5-b383-e41ed03d814c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:10.395678 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b43b1104-9a65-4cf5-b383-e41ed03d814c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:10.399232 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-d3ded672-cb8b-4cee-9080-cf73bdbbb18c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:10.399842 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-d3ded672-cb8b-4cee-9080-cf73bdbbb18c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:10.411600 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b43b1104-9a65-4cf5-b383-e41ed03d814c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:10.413659 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b43b1104-9a65-4cf5-b383-e41ed03d814c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:10.415481 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b43b1104-9a65-4cf5-b383-e41ed03d814c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:10.416064 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d3ded672-cb8b-4cee-9080-cf73bdbbb18c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:10.416566 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d3ded672-cb8b-4cee-9080-cf73bdbbb18c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:10.417078 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b43b1104-9a65-4cf5-b383-e41ed03d814c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:10.417354 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d3ded672-cb8b-4cee-9080-cf73bdbbb18c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:10.417793 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d3ded672-cb8b-4cee-9080-cf73bdbbb18c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:10.672250 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d3ded672-cb8b-4cee-9080-cf73bdbbb18c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:10.700955 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b43b1104-9a65-4cf5-b383-e41ed03d814c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:10.708389 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d3ded672-cb8b-4cee-9080-cf73bdbbb18c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:10.710380 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d3ded672-cb8b-4cee-9080-cf73bdbbb18c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:10.710799 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b43b1104-9a65-4cf5-b383-e41ed03d814c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1733 microversion: 2.1 time: 0.325857 Jun 25 16:10:10.711426 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 246/487] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:10:10 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1733 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:10:10.722712 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-d3ded672-cb8b-4cee-9080-cf73bdbbb18c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1808 microversion: 2.20 time: 0.320956 Jun 25 16:10:10.722712 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 242/488] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:10:10 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1808 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 16:10:11.728993 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-bf162e33-44ee-4de2-a0f0-c5a6700a8914 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:11.729619 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-bf162e33-44ee-4de2-a0f0-c5a6700a8914 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:11.736379 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-187a3cb1-fe8c-4826-b613-53f04de8dcba tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:11.737205 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-187a3cb1-fe8c-4826-b613-53f04de8dcba tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:11.737420 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bf162e33-44ee-4de2-a0f0-c5a6700a8914 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:11.737912 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bf162e33-44ee-4de2-a0f0-c5a6700a8914 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:11.738663 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bf162e33-44ee-4de2-a0f0-c5a6700a8914 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:11.739180 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:10:11.739313 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bf162e33-44ee-4de2-a0f0-c5a6700a8914 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:11.745184 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-187a3cb1-fe8c-4826-b613-53f04de8dcba tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:11.745667 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-187a3cb1-fe8c-4826-b613-53f04de8dcba tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:11.746428 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-187a3cb1-fe8c-4826-b613-53f04de8dcba tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:11.746857 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-187a3cb1-fe8c-4826-b613-53f04de8dcba tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:11.980355 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-bf162e33-44ee-4de2-a0f0-c5a6700a8914 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:11.983343 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-187a3cb1-fe8c-4826-b613-53f04de8dcba tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:11.991010 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-bf162e33-44ee-4de2-a0f0-c5a6700a8914 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1733 microversion: 2.1 time: 0.265855 Jun 25 16:10:11.991735 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 247/489] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:10:11 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1733 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:10:11.992902 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-187a3cb1-fe8c-4826-b613-53f04de8dcba tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:11.994438 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-187a3cb1-fe8c-4826-b613-53f04de8dcba tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:11.995593 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-187a3cb1-fe8c-4826-b613-53f04de8dcba tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1808 microversion: 2.20 time: 0.264263 Jun 25 16:10:11.996128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 243/490] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:10:11 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1808 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:10:13.008930 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-404d0ee0-a73a-4fcc-82ae-9f5fb0c53e5b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:13.010852 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-404d0ee0-a73a-4fcc-82ae-9f5fb0c53e5b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:13.017243 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-f965140f-412b-4bb1-9056-472f412e3b5c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:13.018122 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-f965140f-412b-4bb1-9056-472f412e3b5c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:13.018662 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-404d0ee0-a73a-4fcc-82ae-9f5fb0c53e5b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:13.019142 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-404d0ee0-a73a-4fcc-82ae-9f5fb0c53e5b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:13.019917 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-404d0ee0-a73a-4fcc-82ae-9f5fb0c53e5b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:13.020342 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-404d0ee0-a73a-4fcc-82ae-9f5fb0c53e5b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:13.025385 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f965140f-412b-4bb1-9056-472f412e3b5c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:13.025822 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f965140f-412b-4bb1-9056-472f412e3b5c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:13.026595 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f965140f-412b-4bb1-9056-472f412e3b5c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:13.027193 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f965140f-412b-4bb1-9056-472f412e3b5c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:13.031275 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:10:13.224991 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-404d0ee0-a73a-4fcc-82ae-9f5fb0c53e5b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:13.228509 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-f965140f-412b-4bb1-9056-472f412e3b5c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:13.240639 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-404d0ee0-a73a-4fcc-82ae-9f5fb0c53e5b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1733 microversion: 2.1 time: 0.235602 Jun 25 16:10:13.242157 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-f965140f-412b-4bb1-9056-472f412e3b5c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:13.243098 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 248/491] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:10:13 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1733 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:10:13.244753 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-f965140f-412b-4bb1-9056-472f412e3b5c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:13.246277 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-f965140f-412b-4bb1-9056-472f412e3b5c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1808 microversion: 2.20 time: 0.234656 Jun 25 16:10:13.246896 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 244/492] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:10:13 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1808 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 16:10:14.259266 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8210395b-3cce-46b6-804e-95efb836d258 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:14.259885 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8210395b-3cce-46b6-804e-95efb836d258 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:14.266158 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-5b3be978-0eb5-4e87-9460-f9d1d0c48738 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:14.266747 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-5b3be978-0eb5-4e87-9460-f9d1d0c48738 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:14.267157 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8210395b-3cce-46b6-804e-95efb836d258 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:14.267636 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8210395b-3cce-46b6-804e-95efb836d258 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:14.268852 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8210395b-3cce-46b6-804e-95efb836d258 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:14.268971 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8210395b-3cce-46b6-804e-95efb836d258 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:14.273723 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5b3be978-0eb5-4e87-9460-f9d1d0c48738 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:14.274190 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5b3be978-0eb5-4e87-9460-f9d1d0c48738 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:14.274913 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5b3be978-0eb5-4e87-9460-f9d1d0c48738 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:14.275349 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5b3be978-0eb5-4e87-9460-f9d1d0c48738 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:14.470729 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8210395b-3cce-46b6-804e-95efb836d258 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:14.474974 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-5b3be978-0eb5-4e87-9460-f9d1d0c48738 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:14.480210 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8210395b-3cce-46b6-804e-95efb836d258 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1733 microversion: 2.1 time: 0.224772 Jun 25 16:10:14.480821 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 249/493] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:10:14 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1733 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:10:14.484601 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-5b3be978-0eb5-4e87-9460-f9d1d0c48738 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:14.486371 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-5b3be978-0eb5-4e87-9460-f9d1d0c48738 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:14.487874 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-5b3be978-0eb5-4e87-9460-f9d1d0c48738 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1808 microversion: 2.20 time: 0.225934 Jun 25 16:10:14.493506 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 245/494] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:10:14 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 16:10:15.505909 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-6f811431-b5c2-4de7-bbd3-020da7c303c9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:15.506718 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-6f811431-b5c2-4de7-bbd3-020da7c303c9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:15.508973 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-78e4af0e-976f-4bea-845b-74f0593ca514 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:15.509612 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-78e4af0e-976f-4bea-845b-74f0593ca514 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:15.520480 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6f811431-b5c2-4de7-bbd3-020da7c303c9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:15.520915 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6f811431-b5c2-4de7-bbd3-020da7c303c9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:15.521697 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6f811431-b5c2-4de7-bbd3-020da7c303c9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:15.522682 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6f811431-b5c2-4de7-bbd3-020da7c303c9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:15.523742 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-78e4af0e-976f-4bea-845b-74f0593ca514 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:15.524198 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-78e4af0e-976f-4bea-845b-74f0593ca514 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:15.525186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-78e4af0e-976f-4bea-845b-74f0593ca514 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:15.525604 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-78e4af0e-976f-4bea-845b-74f0593ca514 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:15.711153 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-78e4af0e-976f-4bea-845b-74f0593ca514 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:15.720322 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-78e4af0e-976f-4bea-845b-74f0593ca514 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1733 microversion: 2.1 time: 0.224989 Jun 25 16:10:15.726781 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 250/495] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:10:15 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1733 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:10:15.736731 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-6f811431-b5c2-4de7-bbd3-020da7c303c9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:15.761918 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-6f811431-b5c2-4de7-bbd3-020da7c303c9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:15.766801 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-6f811431-b5c2-4de7-bbd3-020da7c303c9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:15.768998 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-6f811431-b5c2-4de7-bbd3-020da7c303c9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1808 microversion: 2.20 time: 0.267030 Jun 25 16:10:15.770203 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 246/496] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:10:15 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1808 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:10:16.743639 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-34139315-89c8-427a-961f-4c3e7aa1b420 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:16.745272 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-34139315-89c8-427a-961f-4c3e7aa1b420 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:16.752792 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-34139315-89c8-427a-961f-4c3e7aa1b420 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:16.753485 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-34139315-89c8-427a-961f-4c3e7aa1b420 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:16.754395 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-34139315-89c8-427a-961f-4c3e7aa1b420 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:16.754832 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-34139315-89c8-427a-961f-4c3e7aa1b420 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:16.788583 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-0439da97-d4b5-40e9-a2e7-331f6245301e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:16.789327 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-0439da97-d4b5-40e9-a2e7-331f6245301e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:16.800824 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0439da97-d4b5-40e9-a2e7-331f6245301e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:16.801322 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0439da97-d4b5-40e9-a2e7-331f6245301e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:16.802147 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0439da97-d4b5-40e9-a2e7-331f6245301e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:16.802583 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0439da97-d4b5-40e9-a2e7-331f6245301e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:16.978625 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-34139315-89c8-427a-961f-4c3e7aa1b420 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:17.006696 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-34139315-89c8-427a-961f-4c3e7aa1b420 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1733 microversion: 2.1 time: 0.263942 Jun 25 16:10:17.009598 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 251/497] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:10:16 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1733 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:10:17.024519 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-0439da97-d4b5-40e9-a2e7-331f6245301e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:17.034848 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-0439da97-d4b5-40e9-a2e7-331f6245301e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:17.036338 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-0439da97-d4b5-40e9-a2e7-331f6245301e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:17.038033 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-0439da97-d4b5-40e9-a2e7-331f6245301e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1808 microversion: 2.20 time: 0.254233 Jun 25 16:10:17.038621 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 247/498] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:10:16 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1808 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:10:18.027732 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ebddb8c5-8721-48fc-86e9-13a5321b550c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:18.028360 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ebddb8c5-8721-48fc-86e9-13a5321b550c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:18.035319 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ebddb8c5-8721-48fc-86e9-13a5321b550c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:18.035770 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ebddb8c5-8721-48fc-86e9-13a5321b550c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:18.036972 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ebddb8c5-8721-48fc-86e9-13a5321b550c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:18.037411 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ebddb8c5-8721-48fc-86e9-13a5321b550c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:18.062075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-4764e281-b5ed-4b49-810a-e4e1f4017b2c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:18.062688 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-4764e281-b5ed-4b49-810a-e4e1f4017b2c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:18.070488 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4764e281-b5ed-4b49-810a-e4e1f4017b2c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:18.071190 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4764e281-b5ed-4b49-810a-e4e1f4017b2c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:18.072116 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4764e281-b5ed-4b49-810a-e4e1f4017b2c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:18.072888 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4764e281-b5ed-4b49-810a-e4e1f4017b2c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:18.323125 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ebddb8c5-8721-48fc-86e9-13a5321b550c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:18.337841 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-4764e281-b5ed-4b49-810a-e4e1f4017b2c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:18.340397 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ebddb8c5-8721-48fc-86e9-13a5321b550c tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1733 microversion: 2.1 time: 0.316862 Jun 25 16:10:18.341372 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 252/499] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:10:18 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1733 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:10:18.352598 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-4764e281-b5ed-4b49-810a-e4e1f4017b2c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:18.354736 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-4764e281-b5ed-4b49-810a-e4e1f4017b2c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:18.356303 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-4764e281-b5ed-4b49-810a-e4e1f4017b2c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1808 microversion: 2.20 time: 0.302026 Jun 25 16:10:18.367567 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 248/500] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:10:18 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1808 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:10:19.359011 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-085632f0-b051-4bea-86fe-3c1ad08f4cdd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:19.359609 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-085632f0-b051-4bea-86fe-3c1ad08f4cdd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:19.366548 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-085632f0-b051-4bea-86fe-3c1ad08f4cdd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:19.367000 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-085632f0-b051-4bea-86fe-3c1ad08f4cdd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:19.367769 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-085632f0-b051-4bea-86fe-3c1ad08f4cdd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:19.368199 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-085632f0-b051-4bea-86fe-3c1ad08f4cdd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:19.380308 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-4c6e8ad0-0a24-4b6b-8606-e24f1e384365 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:19.380970 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-4c6e8ad0-0a24-4b6b-8606-e24f1e384365 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:19.387721 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4c6e8ad0-0a24-4b6b-8606-e24f1e384365 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:19.388352 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4c6e8ad0-0a24-4b6b-8606-e24f1e384365 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:19.389158 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4c6e8ad0-0a24-4b6b-8606-e24f1e384365 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:19.390011 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4c6e8ad0-0a24-4b6b-8606-e24f1e384365 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:19.582210 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-085632f0-b051-4bea-86fe-3c1ad08f4cdd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:19.587076 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-4c6e8ad0-0a24-4b6b-8606-e24f1e384365 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:19.591277 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-085632f0-b051-4bea-86fe-3c1ad08f4cdd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1733 microversion: 2.1 time: 0.236118 Jun 25 16:10:19.591852 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 253/501] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:10:19 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1733 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:10:19.602556 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-4c6e8ad0-0a24-4b6b-8606-e24f1e384365 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:19.604124 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-4c6e8ad0-0a24-4b6b-8606-e24f1e384365 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:19.605451 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-4c6e8ad0-0a24-4b6b-8606-e24f1e384365 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1808 microversion: 2.20 time: 0.234117 Jun 25 16:10:19.606008 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 249/502] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:10:19 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1808 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 16:10:20.612710 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6b160d11-7ba4-47f0-9c8d-133ac9e4e5b0 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:20.613678 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6b160d11-7ba4-47f0-9c8d-133ac9e4e5b0 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:20.624625 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6b160d11-7ba4-47f0-9c8d-133ac9e4e5b0 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:20.625286 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6b160d11-7ba4-47f0-9c8d-133ac9e4e5b0 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:20.626000 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-1450d5c1-8a83-4e05-a026-1bd787f4f4e9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:20.627034 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-1450d5c1-8a83-4e05-a026-1bd787f4f4e9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:20.627146 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6b160d11-7ba4-47f0-9c8d-133ac9e4e5b0 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:20.627636 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6b160d11-7ba4-47f0-9c8d-133ac9e4e5b0 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:20.633769 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1450d5c1-8a83-4e05-a026-1bd787f4f4e9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:20.634224 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1450d5c1-8a83-4e05-a026-1bd787f4f4e9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:20.634992 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1450d5c1-8a83-4e05-a026-1bd787f4f4e9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:20.635432 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1450d5c1-8a83-4e05-a026-1bd787f4f4e9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:20.827642 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6b160d11-7ba4-47f0-9c8d-133ac9e4e5b0 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:20.832132 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-1450d5c1-8a83-4e05-a026-1bd787f4f4e9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:20.836755 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6b160d11-7ba4-47f0-9c8d-133ac9e4e5b0 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1733 microversion: 2.1 time: 0.230276 Jun 25 16:10:20.837629 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 254/503] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:10:20 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1733 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:10:20.846671 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-1450d5c1-8a83-4e05-a026-1bd787f4f4e9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:20.848274 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-1450d5c1-8a83-4e05-a026-1bd787f4f4e9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:20.849477 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-1450d5c1-8a83-4e05-a026-1bd787f4f4e9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1808 microversion: 2.20 time: 0.229370 Jun 25 16:10:20.850250 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 250/504] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:10:20 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1808 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:10:21.855033 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ff02319c-61d8-4089-b219-f51e26816eed tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:21.855994 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ff02319c-61d8-4089-b219-f51e26816eed tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:21.868665 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-b745530e-41e1-4327-bc7e-1e4ae283d7b9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:21.869268 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-b745530e-41e1-4327-bc7e-1e4ae283d7b9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:21.874297 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ff02319c-61d8-4089-b219-f51e26816eed tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:21.874737 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ff02319c-61d8-4089-b219-f51e26816eed tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:21.875504 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ff02319c-61d8-4089-b219-f51e26816eed tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:21.875918 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ff02319c-61d8-4089-b219-f51e26816eed tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:21.884288 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b745530e-41e1-4327-bc7e-1e4ae283d7b9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:21.885159 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b745530e-41e1-4327-bc7e-1e4ae283d7b9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:21.886714 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b745530e-41e1-4327-bc7e-1e4ae283d7b9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:21.887297 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b745530e-41e1-4327-bc7e-1e4ae283d7b9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:22.091579 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ff02319c-61d8-4089-b219-f51e26816eed tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:22.095083 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:10:22.095237 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-b745530e-41e1-4327-bc7e-1e4ae283d7b9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:22.100730 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ff02319c-61d8-4089-b219-f51e26816eed tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1733 microversion: 2.1 time: 0.250605 Jun 25 16:10:22.101306 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 255/505] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:10:21 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1733 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:10:22.104833 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-b745530e-41e1-4327-bc7e-1e4ae283d7b9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:22.106372 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-b745530e-41e1-4327-bc7e-1e4ae283d7b9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:22.107560 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-b745530e-41e1-4327-bc7e-1e4ae283d7b9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1808 microversion: 2.20 time: 0.243248 Jun 25 16:10:22.108172 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 251/506] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:10:21 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1808 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:10:23.118069 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6773e80b-11c6-4136-ab63-c88c73a2b893 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:23.119460 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6773e80b-11c6-4136-ab63-c88c73a2b893 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:23.126265 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-977ad23c-08cb-4ee1-96c8-12eb40f90af3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:23.126924 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-977ad23c-08cb-4ee1-96c8-12eb40f90af3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:23.128919 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6773e80b-11c6-4136-ab63-c88c73a2b893 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:23.129370 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6773e80b-11c6-4136-ab63-c88c73a2b893 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:23.130136 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6773e80b-11c6-4136-ab63-c88c73a2b893 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:23.130568 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6773e80b-11c6-4136-ab63-c88c73a2b893 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:23.141104 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-977ad23c-08cb-4ee1-96c8-12eb40f90af3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:23.141549 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-977ad23c-08cb-4ee1-96c8-12eb40f90af3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:23.142367 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-977ad23c-08cb-4ee1-96c8-12eb40f90af3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:23.142783 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-977ad23c-08cb-4ee1-96c8-12eb40f90af3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:23.341172 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6773e80b-11c6-4136-ab63-c88c73a2b893 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:23.350829 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6773e80b-11c6-4136-ab63-c88c73a2b893 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1733 microversion: 2.1 time: 0.236804 Jun 25 16:10:23.351415 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 256/507] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:10:23 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1733 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:10:23.353684 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-977ad23c-08cb-4ee1-96c8-12eb40f90af3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:23.362957 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-977ad23c-08cb-4ee1-96c8-12eb40f90af3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:23.364517 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-977ad23c-08cb-4ee1-96c8-12eb40f90af3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:23.365670 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-977ad23c-08cb-4ee1-96c8-12eb40f90af3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1808 microversion: 2.20 time: 0.243292 Jun 25 16:10:23.366328 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 252/508] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:10:23 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1808 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 16:10:24.368175 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-79d0d8e8-2246-4b70-817f-9fea621cec38 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:24.368809 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-79d0d8e8-2246-4b70-817f-9fea621cec38 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:24.376187 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-79d0d8e8-2246-4b70-817f-9fea621cec38 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:24.376841 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-79d0d8e8-2246-4b70-817f-9fea621cec38 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:24.377719 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-79d0d8e8-2246-4b70-817f-9fea621cec38 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:24.378141 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-79d0d8e8-2246-4b70-817f-9fea621cec38 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:24.383832 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-b9ef3f05-8fdc-4576-afbe-a328c206178e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:24.384451 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-b9ef3f05-8fdc-4576-afbe-a328c206178e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:24.391682 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b9ef3f05-8fdc-4576-afbe-a328c206178e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:24.392172 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b9ef3f05-8fdc-4576-afbe-a328c206178e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:24.393256 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b9ef3f05-8fdc-4576-afbe-a328c206178e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:24.393693 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b9ef3f05-8fdc-4576-afbe-a328c206178e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:24.598299 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-79d0d8e8-2246-4b70-817f-9fea621cec38 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:24.606907 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-79d0d8e8-2246-4b70-817f-9fea621cec38 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1713 microversion: 2.1 time: 0.243138 Jun 25 16:10:24.607486 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 257/509] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:10:24 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1713 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:10:24.620105 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-b9ef3f05-8fdc-4576-afbe-a328c206178e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:24.628918 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-b9ef3f05-8fdc-4576-afbe-a328c206178e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:24.630406 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-b9ef3f05-8fdc-4576-afbe-a328c206178e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:24.631559 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-b9ef3f05-8fdc-4576-afbe-a328c206178e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1808 microversion: 2.20 time: 0.251916 Jun 25 16:10:24.632078 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 253/510] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:10:24 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1808 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 16:10:24.714194 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2f1f303c-748b-4808-b136-cefaa98cacc3 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:24.714951 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2f1f303c-748b-4808-b136-cefaa98cacc3 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:24.724174 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f1f303c-748b-4808-b136-cefaa98cacc3 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:24.724742 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f1f303c-748b-4808-b136-cefaa98cacc3 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:24.725885 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f1f303c-748b-4808-b136-cefaa98cacc3 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:24.726545 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f1f303c-748b-4808-b136-cefaa98cacc3 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:24.818837 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-2f1f303c-748b-4808-b136-cefaa98cacc3 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] HTTP exception thrown: Cannot 'detach_volume' instance 8de27285-8f18-4d98-b240-0042e68f7ff9 while it is in vm_state rescued Jun 25 16:10:24.820445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2f1f303c-748b-4808-b136-cefaa98cacc3 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Request method failure captured: Jun 25 16:10:24.820445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: request: DELETE /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9/os-volume_attachments/c7a77e46-f8e7-4dad-b3d5-9b120e204547 HTTP/1.1 Jun 25 16:10:24.820445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept: application/json Jun 25 16:10:24.820445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jun 25 16:10:24.820445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Connection: close Jun 25 16:10:24.820445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jun 25 16:10:24.820445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jun 25 16:10:24.820445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Host: 10.222.0.13 Jun 25 16:10:24.820445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jun 25 16:10:24.820445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jun 25 16:10:24.820445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABitzJy2PMEIGjU0D22ICPLrII0pgH6H7ewD2vw5w9vg92aD4-QfJukh_sXEAnvvJYv-lOHCKFN3Jsua1OnxR1mP-RhqYo9qs23StrKXzzDyf_m8VzQ_Av2b07vGTVgZTS2cklgCU5QDM54FSOcZVCDlTXhs3O31jqJozgvouxgWWInUng Jun 25 16:10:24.820445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jun 25 16:10:24.820445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jun 25 16:10:24.820445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jun 25 16:10:24.820445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jun 25 16:10:24.820445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jun 25 16:10:24.820445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jun 25 16:10:24.820445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Id: 9bcee16336834b80a389799f89b5b79a Jun 25 16:10:24.820445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1688542009 Jun 25 16:10:24.820445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Role: reader,member Jun 25 16:10:24.820445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Jun 25 16:10:24.822113 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9bcee16336834b80a389799f89b5b79a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9bcee16336834b80a389799f89b5b79a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9bcee16336834b80a389799f89b5b79a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9bcee16336834b80a389799f89b5b79a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:10:24.822113 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1688542009 Jun 25 16:10:24.822113 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 9bcee16336834b80a389799f89b5b79a Jun 25 16:10:24.822113 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1688542009 Jun 25 16:10:24.822113 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User: tempest-ServerRescueNegativeTestJSON-1688542009-project Jun 25 16:10:24.822113 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jun 25 16:10:24.822113 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jun 25 16:10:24.822113 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Id: 8a3137566b004edb909d4e3c702a7f59 Jun 25 16:10:24.822113 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1688542009-project Jun 25 16:10:24.822113 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: method: > Jun 25 16:10:24.822113 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: exception: Cannot 'detach_volume' instance 8de27285-8f18-4d98-b240-0042e68f7ff9 while it is in vm_state rescued Jun 25 16:10:24.822920 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: action_args: {'server_id': '8de27285-8f18-4d98-b240-0042e68f7ff9', 'id': 'c7a77e46-f8e7-4dad-b3d5-9b120e204547'} Jun 25 16:10:24.822920 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:10:24.822920 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:10:24.822920 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 25 16:10:24.822920 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 25 16:10:24.822920 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 25 16:10:24.822920 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 16:10:24.822920 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 25 16:10:24.822920 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 25 16:10:24.822920 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8de27285-8f18-4d98-b240-0042e68f7ff9 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 25 16:10:24.822920 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:10:24.822920 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:10:24.822920 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:10:24.822920 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:10:24.822920 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:10:24.822920 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:10:24.822920 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:10:24.822920 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:10:24.822920 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:10:24.822920 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:10:24.824221 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 25 16:10:24.824221 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 25 16:10:24.824221 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 25 16:10:24.824221 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 25 16:10:24.824221 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8de27285-8f18-4d98-b240-0042e68f7ff9 while it is in vm_state rescued Jun 25 16:10:24.824221 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:10:24.824221 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:10:24.824221 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:10:24.824221 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:10:24.824221 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:10:24.824221 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:10:24.824221 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:10:24.824221 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:10:24.824221 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8de27285-8f18-4d98-b240-0042e68f7ff9 while it is in vm_state rescued Jun 25 16:10:24.824221 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:10:24.824221 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2f1f303c-748b-4808-b136-cefaa98cacc3 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Returning 409 to user: Cannot 'detach_volume' instance 8de27285-8f18-4d98-b240-0042e68f7ff9 while it is in vm_state rescued {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:10:24.825234 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2f1f303c-748b-4808-b136-cefaa98cacc3 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9/os-volume_attachments/c7a77e46-f8e7-4dad-b3d5-9b120e204547" status: 409 len: 152 microversion: 2.1 time: 0.113671 Jun 25 16:10:24.825234 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 258/511] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Jun 25 16:10:24 2022] DELETE /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9/os-volume_attachments/c7a77e46-f8e7-4dad-b3d5-9b120e204547 => generated 152 bytes in 115 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 25 16:10:24.831486 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-51f7ec78-2175-46e5-ba9a-593843f85799 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:10:24.832092 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-51f7ec78-2175-46e5-ba9a-593843f85799 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:24.838641 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-51f7ec78-2175-46e5-ba9a-593843f85799 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:24.839571 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-51f7ec78-2175-46e5-ba9a-593843f85799 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:24.840539 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-51f7ec78-2175-46e5-ba9a-593843f85799 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:24.841213 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-51f7ec78-2175-46e5-ba9a-593843f85799 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:24.926744 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-51f7ec78-2175-46e5-ba9a-593843f85799 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "POST /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9/action" status: 202 len: 0 microversion: 2.1 time: 0.099421 Jun 25 16:10:24.927539 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 254/512] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Jun 25 16:10:24 2022] POST /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 16:10:24.935950 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-908849f6-607e-45e1-a2b6-26e5dd0a6da5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:24.936681 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-908849f6-607e-45e1-a2b6-26e5dd0a6da5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:24.943377 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-908849f6-607e-45e1-a2b6-26e5dd0a6da5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:24.943858 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-908849f6-607e-45e1-a2b6-26e5dd0a6da5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:24.944714 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-908849f6-607e-45e1-a2b6-26e5dd0a6da5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:24.947096 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-908849f6-607e-45e1-a2b6-26e5dd0a6da5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:25.086187 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-908849f6-607e-45e1-a2b6-26e5dd0a6da5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:25.095681 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-908849f6-607e-45e1-a2b6-26e5dd0a6da5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1721 microversion: 2.1 time: 0.163473 Jun 25 16:10:25.096182 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 259/513] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:10:24 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:10:25.652641 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-c3f475c8-2921-40b4-b07d-48a0341e42e3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:25.653365 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-c3f475c8-2921-40b4-b07d-48a0341e42e3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:25.660529 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-c3f475c8-2921-40b4-b07d-48a0341e42e3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:25.661042 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-c3f475c8-2921-40b4-b07d-48a0341e42e3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:25.664161 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-c3f475c8-2921-40b4-b07d-48a0341e42e3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:25.664161 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-c3f475c8-2921-40b4-b07d-48a0341e42e3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:25.800561 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-c3f475c8-2921-40b4-b07d-48a0341e42e3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:25.810011 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-c3f475c8-2921-40b4-b07d-48a0341e42e3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:25.811517 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-c3f475c8-2921-40b4-b07d-48a0341e42e3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:25.812705 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-c3f475c8-2921-40b4-b07d-48a0341e42e3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1808 microversion: 2.20 time: 0.165027 Jun 25 16:10:25.813269 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 255/514] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:10:25 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:10:26.114459 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d665ab48-629d-4959-82ec-2318fd1a42cd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:26.115016 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d665ab48-629d-4959-82ec-2318fd1a42cd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:26.122059 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d665ab48-629d-4959-82ec-2318fd1a42cd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:26.122516 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d665ab48-629d-4959-82ec-2318fd1a42cd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:26.123289 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d665ab48-629d-4959-82ec-2318fd1a42cd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:26.123712 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d665ab48-629d-4959-82ec-2318fd1a42cd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:26.301544 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d665ab48-629d-4959-82ec-2318fd1a42cd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:26.310875 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d665ab48-629d-4959-82ec-2318fd1a42cd tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1721 microversion: 2.1 time: 0.200956 Jun 25 16:10:26.312311 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 260/515] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:10:26 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:10:26.831681 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-a3079be6-d15b-4490-8456-02358bef0a30 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:26.832300 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-a3079be6-d15b-4490-8456-02358bef0a30 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:26.839066 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a3079be6-d15b-4490-8456-02358bef0a30 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:26.840330 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a3079be6-d15b-4490-8456-02358bef0a30 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:26.841341 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a3079be6-d15b-4490-8456-02358bef0a30 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:26.841809 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a3079be6-d15b-4490-8456-02358bef0a30 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:26.985645 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-a3079be6-d15b-4490-8456-02358bef0a30 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:26.995084 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-a3079be6-d15b-4490-8456-02358bef0a30 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:26.996691 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-a3079be6-d15b-4490-8456-02358bef0a30 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:26.997905 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-a3079be6-d15b-4490-8456-02358bef0a30 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1808 microversion: 2.20 time: 0.170870 Jun 25 16:10:26.998437 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 256/516] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:10:26 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:10:27.328995 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8a3c80b5-e9c6-4b55-80c1-e21aa48dd17a tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:27.329659 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8a3c80b5-e9c6-4b55-80c1-e21aa48dd17a tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:27.336709 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8a3c80b5-e9c6-4b55-80c1-e21aa48dd17a tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:27.337331 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8a3c80b5-e9c6-4b55-80c1-e21aa48dd17a tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:27.338077 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8a3c80b5-e9c6-4b55-80c1-e21aa48dd17a tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:27.338694 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8a3c80b5-e9c6-4b55-80c1-e21aa48dd17a tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:27.506216 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8a3c80b5-e9c6-4b55-80c1-e21aa48dd17a tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:27.515016 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8a3c80b5-e9c6-4b55-80c1-e21aa48dd17a tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1721 microversion: 2.1 time: 0.189682 Jun 25 16:10:27.515583 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 261/517] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:10:27 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:10:28.017385 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-e824548b-ad92-4edc-a6bd-b06b8e26156e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:28.018439 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-e824548b-ad92-4edc-a6bd-b06b8e26156e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:28.026317 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e824548b-ad92-4edc-a6bd-b06b8e26156e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:28.026764 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e824548b-ad92-4edc-a6bd-b06b8e26156e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:28.027878 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e824548b-ad92-4edc-a6bd-b06b8e26156e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:28.028309 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e824548b-ad92-4edc-a6bd-b06b8e26156e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:28.167371 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-e824548b-ad92-4edc-a6bd-b06b8e26156e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:28.176173 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-e824548b-ad92-4edc-a6bd-b06b8e26156e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:28.177788 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-e824548b-ad92-4edc-a6bd-b06b8e26156e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:28.178934 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-e824548b-ad92-4edc-a6bd-b06b8e26156e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1808 microversion: 2.20 time: 0.167512 Jun 25 16:10:28.179477 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 257/518] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:10:28 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:10:28.532487 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-fcb5b1b7-f866-4e44-8c4a-2a9c5a2ea7b5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:28.533123 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-fcb5b1b7-f866-4e44-8c4a-2a9c5a2ea7b5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:28.539922 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fcb5b1b7-f866-4e44-8c4a-2a9c5a2ea7b5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:28.540374 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fcb5b1b7-f866-4e44-8c4a-2a9c5a2ea7b5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:28.541164 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fcb5b1b7-f866-4e44-8c4a-2a9c5a2ea7b5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:28.541578 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fcb5b1b7-f866-4e44-8c4a-2a9c5a2ea7b5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:28.679959 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fcb5b1b7-f866-4e44-8c4a-2a9c5a2ea7b5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:28.688224 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-fcb5b1b7-f866-4e44-8c4a-2a9c5a2ea7b5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1721 microversion: 2.1 time: 0.159647 Jun 25 16:10:28.689121 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 262/519] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:10:28 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:10:29.201325 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-9240654c-dade-4dbf-8d9f-da0cbbab036b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:29.202253 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-9240654c-dade-4dbf-8d9f-da0cbbab036b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:29.210230 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9240654c-dade-4dbf-8d9f-da0cbbab036b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:29.210717 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9240654c-dade-4dbf-8d9f-da0cbbab036b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:29.211494 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9240654c-dade-4dbf-8d9f-da0cbbab036b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:29.211934 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9240654c-dade-4dbf-8d9f-da0cbbab036b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:29.349747 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-9240654c-dade-4dbf-8d9f-da0cbbab036b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:29.358373 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-9240654c-dade-4dbf-8d9f-da0cbbab036b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:29.359823 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-9240654c-dade-4dbf-8d9f-da0cbbab036b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:29.361069 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-9240654c-dade-4dbf-8d9f-da0cbbab036b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1808 microversion: 2.20 time: 0.166265 Jun 25 16:10:29.361633 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 258/520] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:10:29 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:10:29.467933 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-4eb6f0a3-8202-4885-b72b-4eca73b43551 req-71760a9b-759e-42a7-9b33-b6b19e3db03b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6ae5a58-db83-401e-a158-ebf0981e84ec", "name": "network-vif-plugged", "status": "completed", "tag": "3115b4bc-8a8e-494e-90f7-66772013aaf5"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:10:29.476785 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-4eb6f0a3-8202-4885-b72b-4eca73b43551 req-71760a9b-759e-42a7-9b33-b6b19e3db03b service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:29.477361 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-4eb6f0a3-8202-4885-b72b-4eca73b43551 req-71760a9b-759e-42a7-9b33-b6b19e3db03b service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:29.488844 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-4eb6f0a3-8202-4885-b72b-4eca73b43551 req-71760a9b-759e-42a7-9b33-b6b19e3db03b service nova] Creating event network-vif-plugged:3115b4bc-8a8e-494e-90f7-66772013aaf5 for instance e6ae5a58-db83-401e-a158-ebf0981e84ec on hv-cinder-84762 Jun 25 16:10:29.493892 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-4eb6f0a3-8202-4885-b72b-4eca73b43551 req-71760a9b-759e-42a7-9b33-b6b19e3db03b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029624 Jun 25 16:10:29.494672 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 263/521] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:10:29.707378 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-26df32ff-db00-4fb6-832e-15e91c6807ca tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:29.708096 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-26df32ff-db00-4fb6-832e-15e91c6807ca tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:29.714450 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-26df32ff-db00-4fb6-832e-15e91c6807ca tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:29.714900 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-26df32ff-db00-4fb6-832e-15e91c6807ca tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:29.715674 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-26df32ff-db00-4fb6-832e-15e91c6807ca tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:29.716109 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-26df32ff-db00-4fb6-832e-15e91c6807ca tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:29.859593 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-26df32ff-db00-4fb6-832e-15e91c6807ca tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:29.867665 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:10:29.873844 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-26df32ff-db00-4fb6-832e-15e91c6807ca tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1727 microversion: 2.1 time: 0.170335 Jun 25 16:10:29.874389 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 259/522] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:10:29 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:10:29.892326 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-10577d10-ed52-425e-b1a2-7303bc3ecc87 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:29.893075 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-10577d10-ed52-425e-b1a2-7303bc3ecc87 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:29.899270 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-10577d10-ed52-425e-b1a2-7303bc3ecc87 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:29.899714 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-10577d10-ed52-425e-b1a2-7303bc3ecc87 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:29.900496 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-10577d10-ed52-425e-b1a2-7303bc3ecc87 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:29.900934 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-10577d10-ed52-425e-b1a2-7303bc3ecc87 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:29.980352 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-10577d10-ed52-425e-b1a2-7303bc3ecc87 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093030 Jun 25 16:10:29.981162 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 264/523] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Jun 25 16:10:29 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:10:30.380293 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-08f68364-7fee-4363-ab9b-5be68c219dc6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:30.380871 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-08f68364-7fee-4363-ab9b-5be68c219dc6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:30.388100 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-08f68364-7fee-4363-ab9b-5be68c219dc6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:30.388700 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-08f68364-7fee-4363-ab9b-5be68c219dc6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:30.389424 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-08f68364-7fee-4363-ab9b-5be68c219dc6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:30.390172 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-08f68364-7fee-4363-ab9b-5be68c219dc6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:30.622739 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-08f68364-7fee-4363-ab9b-5be68c219dc6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:30.631648 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-08f68364-7fee-4363-ab9b-5be68c219dc6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:30.633123 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-08f68364-7fee-4363-ab9b-5be68c219dc6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:30.634284 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-08f68364-7fee-4363-ab9b-5be68c219dc6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1808 microversion: 2.20 time: 0.258877 Jun 25 16:10:30.634839 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 260/524] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:10:30 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1808 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:10:31.185469 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-a3f935b2-e1e4-4785-a197-a78ab1efa902 req-8ce4ab10-4e13-4a14-9b45-e50dc7013897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8de27285-8f18-4d98-b240-0042e68f7ff9", "tag": "17f4711f-55ed-463b-986b-2d3077795600"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:10:31.194540 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-a3f935b2-e1e4-4785-a197-a78ab1efa902 req-8ce4ab10-4e13-4a14-9b45-e50dc7013897 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:31.194987 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-a3f935b2-e1e4-4785-a197-a78ab1efa902 req-8ce4ab10-4e13-4a14-9b45-e50dc7013897 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:31.207596 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-a3f935b2-e1e4-4785-a197-a78ab1efa902 req-8ce4ab10-4e13-4a14-9b45-e50dc7013897 service nova] Creating event network-changed:17f4711f-55ed-463b-986b-2d3077795600 for instance 8de27285-8f18-4d98-b240-0042e68f7ff9 on hv-cinder-84762 Jun 25 16:10:31.212598 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-a3f935b2-e1e4-4785-a197-a78ab1efa902 req-8ce4ab10-4e13-4a14-9b45-e50dc7013897 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031326 Jun 25 16:10:31.213221 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 265/525] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:10:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:10:31.653228 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-47deb204-28a4-4ccd-85fe-9336412c375a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:31.653831 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-47deb204-28a4-4ccd-85fe-9336412c375a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:31.661981 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-47deb204-28a4-4ccd-85fe-9336412c375a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:31.662432 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-47deb204-28a4-4ccd-85fe-9336412c375a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:31.663530 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-47deb204-28a4-4ccd-85fe-9336412c375a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:31.664063 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-47deb204-28a4-4ccd-85fe-9336412c375a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:31.824398 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-47deb204-28a4-4ccd-85fe-9336412c375a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:31.833834 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-47deb204-28a4-4ccd-85fe-9336412c375a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:31.835763 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-47deb204-28a4-4ccd-85fe-9336412c375a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:31.837443 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-47deb204-28a4-4ccd-85fe-9336412c375a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1808 microversion: 2.20 time: 0.188098 Jun 25 16:10:31.840468 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 261/526] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:10:31 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:10:32.857996 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8264d529-c5f9-4257-9398-f45abdfd7b0c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:32.858642 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8264d529-c5f9-4257-9398-f45abdfd7b0c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:32.865601 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8264d529-c5f9-4257-9398-f45abdfd7b0c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:32.866048 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8264d529-c5f9-4257-9398-f45abdfd7b0c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:32.866814 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8264d529-c5f9-4257-9398-f45abdfd7b0c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:32.867241 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8264d529-c5f9-4257-9398-f45abdfd7b0c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:33.014191 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8264d529-c5f9-4257-9398-f45abdfd7b0c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:33.023447 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8264d529-c5f9-4257-9398-f45abdfd7b0c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:33.024973 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8264d529-c5f9-4257-9398-f45abdfd7b0c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:33.026124 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8264d529-c5f9-4257-9398-f45abdfd7b0c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1795 microversion: 2.20 time: 0.173059 Jun 25 16:10:33.026685 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 266/527] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:10:32 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1795 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:10:33.232480 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-cb3f590e-2d65-46ba-a221-2b22a97fd460 req-dcbdd508-1304-4185-b406-78fd8bed588f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8de27285-8f18-4d98-b240-0042e68f7ff9", "tag": "17f4711f-55ed-463b-986b-2d3077795600"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:10:33.243271 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-cb3f590e-2d65-46ba-a221-2b22a97fd460 req-dcbdd508-1304-4185-b406-78fd8bed588f service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:33.243708 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-cb3f590e-2d65-46ba-a221-2b22a97fd460 req-dcbdd508-1304-4185-b406-78fd8bed588f service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:33.257543 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-cb3f590e-2d65-46ba-a221-2b22a97fd460 req-dcbdd508-1304-4185-b406-78fd8bed588f service nova] Creating event network-changed:17f4711f-55ed-463b-986b-2d3077795600 for instance 8de27285-8f18-4d98-b240-0042e68f7ff9 on hv-cinder-84762 Jun 25 16:10:33.264012 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-cb3f590e-2d65-46ba-a221-2b22a97fd460 req-dcbdd508-1304-4185-b406-78fd8bed588f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037198 Jun 25 16:10:33.265205 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 262/528] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:10:46.685728 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-aafba7f4-11a3-49d8-89b3-9f4cd16baeb7 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:46.686651 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-aafba7f4-11a3-49d8-89b3-9f4cd16baeb7 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:46.690120 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=55 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:10:46.691348 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=56 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:10:46.702873 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aafba7f4-11a3-49d8-89b3-9f4cd16baeb7 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:46.703758 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aafba7f4-11a3-49d8-89b3-9f4cd16baeb7 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:46.704896 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aafba7f4-11a3-49d8-89b3-9f4cd16baeb7 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:46.705327 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aafba7f4-11a3-49d8-89b3-9f4cd16baeb7 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:46.729062 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-aafba7f4-11a3-49d8-89b3-9f4cd16baeb7 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9/ips" status: 200 len: 149 microversion: 2.1 time: 0.050034 Jun 25 16:10:46.729625 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 267/529] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Jun 25 16:10:46 2022] GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9/ips => generated 149 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:10:48.081206 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_api:SELECT=39 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:10:48.081948 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=14 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:10:48.086306 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-5ad59160-dcf3-43fc-9bbb-f3413fd9caa1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e3ec9cb-4e8b-48bf-a974-16284bb79407"}} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:10:48.087458 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-5ad59160-dcf3-43fc-9bbb-f3413fd9caa1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:48.094639 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5ad59160-dcf3-43fc-9bbb-f3413fd9caa1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:48.095076 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5ad59160-dcf3-43fc-9bbb-f3413fd9caa1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:48.095844 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5ad59160-dcf3-43fc-9bbb-f3413fd9caa1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:48.096272 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5ad59160-dcf3-43fc-9bbb-f3413fd9caa1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:48.348165 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-5ad59160-dcf3-43fc-9bbb-f3413fd9caa1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "POST /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268780 Jun 25 16:10:48.348816 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 263/530] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Jun 25 16:10:48 2022] POST /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:10:55.914392 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-40c05159-cd33-444b-87e2-67e3e1be2d60 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e3ec9cb-4e8b-48bf-a974-16284bb79407"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:10:55.915457 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-40c05159-cd33-444b-87e2-67e3e1be2d60 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:55.922549 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-40c05159-cd33-444b-87e2-67e3e1be2d60 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:55.923161 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-40c05159-cd33-444b-87e2-67e3e1be2d60 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:55.924072 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-40c05159-cd33-444b-87e2-67e3e1be2d60 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:55.924821 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-40c05159-cd33-444b-87e2-67e3e1be2d60 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:56.007913 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-40c05159-cd33-444b-87e2-67e3e1be2d60 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] HTTP exception thrown: Invalid volume: volume 9e3ec9cb-4e8b-48bf-a974-16284bb79407 is already attached to instances: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 Jun 25 16:10:56.009666 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-40c05159-cd33-444b-87e2-67e3e1be2d60 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Request method failure captured: Jun 25 16:10:56.009666 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: request: POST /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9/os-volume_attachments HTTP/1.1 Jun 25 16:10:56.009666 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept: application/json Jun 25 16:10:56.009666 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jun 25 16:10:56.009666 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Connection: close Jun 25 16:10:56.009666 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Length: 74 Jun 25 16:10:56.009666 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jun 25 16:10:56.009666 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Host: 10.222.0.13 Jun 25 16:10:56.009666 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jun 25 16:10:56.009666 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jun 25 16:10:56.009666 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABitzJ4VTX9FBO09dP9eDUNJ7kXDvOeQ_3800jobL_5yAtOgxQI54WUI0jlTKIeeP5rTVj0MTWBlkUxqhr419kWtC1O7I2ACk-hIdi2fMzwDg3khIX53lL7PAAWZJjGvTHF0eyDgeSSmpMCdU8rbC_7cLecxR6vp9KZlm3nwM3ZTo0XAYY Jun 25 16:10:56.009666 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jun 25 16:10:56.009666 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jun 25 16:10:56.009666 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jun 25 16:10:56.009666 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jun 25 16:10:56.009666 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jun 25 16:10:56.009666 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jun 25 16:10:56.009666 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Id: b1bba8f74dbd433bbffdb2ffbfc481fb Jun 25 16:10:56.009666 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:10:56.009666 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Role: reader,member Jun 25 16:10:56.009666 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Jun 25 16:10:56.011206 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b1bba8f74dbd433bbffdb2ffbfc481fb", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:10:56.011206 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:10:56.011206 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Id: b1bba8f74dbd433bbffdb2ffbfc481fb Jun 25 16:10:56.011206 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:10:56.011206 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeNegativeTest-1137598465-project Jun 25 16:10:56.011206 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jun 25 16:10:56.011206 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jun 25 16:10:56.011206 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Id: 19140330ae664e45b85f47f321496191 Jun 25 16:10:56.011206 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeNegativeTest-1137598465-project Jun 25 16:10:56.011206 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Jun 25 16:10:56.011206 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: {"volumeAttachment": {"volumeId": "9e3ec9cb-4e8b-48bf-a974-16284bb79407"}} Jun 25 16:10:56.011206 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: method: > Jun 25 16:10:56.012039 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: exception: Invalid volume: volume 9e3ec9cb-4e8b-48bf-a974-16284bb79407 is already attached to instances: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 Jun 25 16:10:56.012039 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: action_args: {'server_id': 'b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9', 'body': {'volumeAttachment': {'volumeId': '9e3ec9cb-4e8b-48bf-a974-16284bb79407'}}} Jun 25 16:10:56.012039 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:10:56.012039 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:10:56.012039 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 25 16:10:56.012039 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 25 16:10:56.012039 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 25 16:10:56.012039 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 25 16:10:56.012039 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 25 16:10:56.012039 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 25 16:10:56.012039 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 25 16:10:56.012039 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 25 16:10:56.012039 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 25 16:10:56.012039 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 25 16:10:56.012039 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9e3ec9cb-4e8b-48bf-a974-16284bb79407 is already attached to instances: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 Jun 25 16:10:56.012039 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:10:56.012039 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:10:56.012039 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:10:56.012039 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:10:56.013397 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:10:56.013397 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:10:56.013397 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:10:56.013397 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:10:56.013397 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:10:56.013397 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:10:56.013397 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 16:10:56.013397 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 16:10:56.013397 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 16:10:56.013397 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 16:10:56.013397 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 25 16:10:56.013397 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 25 16:10:56.013397 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 25 16:10:56.013397 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 25 16:10:56.013397 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9e3ec9cb-4e8b-48bf-a974-16284bb79407 is already attached to instances: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 Jun 25 16:10:56.013397 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:10:56.013397 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:10:56.013397 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:10:56.013397 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:10:56.013397 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:10:56.015233 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:10:56.015233 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:10:56.015233 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:10:56.015233 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9e3ec9cb-4e8b-48bf-a974-16284bb79407 is already attached to instances: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 Jun 25 16:10:56.015233 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:10:56.015233 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-40c05159-cd33-444b-87e2-67e3e1be2d60 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Returning 400 to user: Invalid volume: volume 9e3ec9cb-4e8b-48bf-a974-16284bb79407 is already attached to instances: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:10:56.015233 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-40c05159-cd33-444b-87e2-67e3e1be2d60 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "POST /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100787 Jun 25 16:10:56.015233 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 268/531] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Jun 25 16:10:55 2022] POST /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 16:10:56.076911 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-48292e24-4819-456e-b084-c0e594c8f3bc tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:56.077665 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-48292e24-4819-456e-b084-c0e594c8f3bc tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:56.088310 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-48292e24-4819-456e-b084-c0e594c8f3bc tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:56.089017 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-48292e24-4819-456e-b084-c0e594c8f3bc tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:56.090177 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-48292e24-4819-456e-b084-c0e594c8f3bc tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:56.090733 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-48292e24-4819-456e-b084-c0e594c8f3bc tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:56.191783 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.objects.instance [None req-48292e24-4819-456e-b084-c0e594c8f3bc tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lazy-loading 'services' on Instance uuid b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 {{(pid=117794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 16:10:56.276884 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-48292e24-4819-456e-b084-c0e594c8f3bc tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9/os-volume_attachments/9e3ec9cb-4e8b-48bf-a974-16284bb79407" status: 202 len: 0 microversion: 2.1 time: 0.207172 Jun 25 16:10:56.277528 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 264/532] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Jun 25 16:10:56 2022] DELETE /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9/os-volume_attachments/9e3ec9cb-4e8b-48bf-a974-16284bb79407 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 16:10:56.286825 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4b5686ce-2e6a-4eda-a995-5b638c7e6b9b tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:56.287743 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4b5686ce-2e6a-4eda-a995-5b638c7e6b9b tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:56.294907 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4b5686ce-2e6a-4eda-a995-5b638c7e6b9b tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:56.295559 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4b5686ce-2e6a-4eda-a995-5b638c7e6b9b tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:56.296495 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4b5686ce-2e6a-4eda-a995-5b638c7e6b9b tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:56.297110 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4b5686ce-2e6a-4eda-a995-5b638c7e6b9b tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:56.330562 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4b5686ce-2e6a-4eda-a995-5b638c7e6b9b tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048423 Jun 25 16:10:56.331111 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 269/533] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Jun 25 16:10:56 2022] GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:10:57.343581 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-2376d2ee-2f38-44ac-bc8d-99f0e66f4345 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:57.344738 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-2376d2ee-2f38-44ac-bc8d-99f0e66f4345 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:57.351434 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2376d2ee-2f38-44ac-bc8d-99f0e66f4345 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:57.351890 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2376d2ee-2f38-44ac-bc8d-99f0e66f4345 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:57.352686 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2376d2ee-2f38-44ac-bc8d-99f0e66f4345 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:57.353125 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2376d2ee-2f38-44ac-bc8d-99f0e66f4345 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:57.382157 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-2376d2ee-2f38-44ac-bc8d-99f0e66f4345 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043285 Jun 25 16:10:57.382633 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 265/534] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Jun 25 16:10:57 2022] GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 16:10:57.444792 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-0cf8dc8c-6fae-4055-bba5-104aa7e6922f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:57.445318 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0cf8dc8c-6fae-4055-bba5-104aa7e6922f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:57.452350 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0cf8dc8c-6fae-4055-bba5-104aa7e6922f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:57.452837 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0cf8dc8c-6fae-4055-bba5-104aa7e6922f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:57.453600 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0cf8dc8c-6fae-4055-bba5-104aa7e6922f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:57.454037 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0cf8dc8c-6fae-4055-bba5-104aa7e6922f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:57.480301 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0cf8dc8c-6fae-4055-bba5-104aa7e6922f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 16:10:57.555595 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-0cf8dc8c-6fae-4055-bba5-104aa7e6922f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9" status: 204 len: 0 microversion: 2.1 time: 0.114539 Jun 25 16:10:57.556306 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 270/535] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Jun 25 16:10:57 2022] DELETE /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 16:10:57.564711 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-9f3a4a50-720f-4ba4-a545-d7cb9c22dc2f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:57.565409 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-9f3a4a50-720f-4ba4-a545-d7cb9c22dc2f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:57.571673 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9f3a4a50-720f-4ba4-a545-d7cb9c22dc2f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:57.572119 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9f3a4a50-720f-4ba4-a545-d7cb9c22dc2f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:57.572961 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9f3a4a50-720f-4ba4-a545-d7cb9c22dc2f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:57.573401 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9f3a4a50-720f-4ba4-a545-d7cb9c22dc2f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:57.705374 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-9f3a4a50-720f-4ba4-a545-d7cb9c22dc2f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:57.713174 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-9f3a4a50-720f-4ba4-a545-d7cb9c22dc2f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9" status: 200 len: 1678 microversion: 2.1 time: 0.152526 Jun 25 16:10:57.713727 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 266/536] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:10:57 2022] GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:10:58.731833 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d88c9177-c499-4455-af12-d4affa70ee70 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:58.732596 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d88c9177-c499-4455-af12-d4affa70ee70 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:58.739741 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d88c9177-c499-4455-af12-d4affa70ee70 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:58.740220 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d88c9177-c499-4455-af12-d4affa70ee70 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:58.741011 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d88c9177-c499-4455-af12-d4affa70ee70 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:58.741443 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d88c9177-c499-4455-af12-d4affa70ee70 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:58.875116 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d88c9177-c499-4455-af12-d4affa70ee70 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:58.883391 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d88c9177-c499-4455-af12-d4affa70ee70 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9" status: 200 len: 1678 microversion: 2.1 time: 0.155820 Jun 25 16:10:58.883947 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 271/537] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:10:58 2022] GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:10:59.900604 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-99c9df52-eb8e-46ef-81ec-39a874a5b702 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:10:59.901200 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-99c9df52-eb8e-46ef-81ec-39a874a5b702 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:10:59.909777 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-99c9df52-eb8e-46ef-81ec-39a874a5b702 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:59.910219 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-99c9df52-eb8e-46ef-81ec-39a874a5b702 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:59.911011 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-99c9df52-eb8e-46ef-81ec-39a874a5b702 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:10:59.911449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-99c9df52-eb8e-46ef-81ec-39a874a5b702 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:10:59.983624 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-99c9df52-eb8e-46ef-81ec-39a874a5b702 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:10:59.992888 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-99c9df52-eb8e-46ef-81ec-39a874a5b702 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9" status: 200 len: 1611 microversion: 2.1 time: 0.096140 Jun 25 16:10:59.994134 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 267/538] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:10:59 2022] GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 => generated 1611 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:00.216525 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-1686a826-8dc9-40cc-8d9a-663e5d1ff9da req-33b0f9bc-81e6-4ca0-9b8f-a3e2e8b109ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9", "name": "network-vif-deleted", "tag": "c9f4f158-6c65-4bbe-8425-f8fcb9a31e68"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:11:00.226397 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-1686a826-8dc9-40cc-8d9a-663e5d1ff9da req-33b0f9bc-81e6-4ca0-9b8f-a3e2e8b109ac service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:00.226709 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-1686a826-8dc9-40cc-8d9a-663e5d1ff9da req-33b0f9bc-81e6-4ca0-9b8f-a3e2e8b109ac service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:00.238751 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-1686a826-8dc9-40cc-8d9a-663e5d1ff9da req-33b0f9bc-81e6-4ca0-9b8f-a3e2e8b109ac service nova] Creating event network-vif-deleted:c9f4f158-6c65-4bbe-8425-f8fcb9a31e68 for instance b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 on hv-cinder-84762 Jun 25 16:11:00.245323 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-1686a826-8dc9-40cc-8d9a-663e5d1ff9da req-33b0f9bc-81e6-4ca0-9b8f-a3e2e8b109ac service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032404 Jun 25 16:11:00.246570 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 272/539] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:11:01.011279 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-d3c7ce69-b3bd-4aa4-b930-8e9798114edd tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:01.012013 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-d3c7ce69-b3bd-4aa4-b930-8e9798114edd tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:01.019654 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d3c7ce69-b3bd-4aa4-b930-8e9798114edd tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:01.020118 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d3c7ce69-b3bd-4aa4-b930-8e9798114edd tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:01.020937 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d3c7ce69-b3bd-4aa4-b930-8e9798114edd tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:01.021376 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d3c7ce69-b3bd-4aa4-b930-8e9798114edd tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:01.035693 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.wsgi [None req-d3c7ce69-b3bd-4aa4-b930-8e9798114edd tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] HTTP exception thrown: Instance b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 could not be found. Jun 25 16:11:01.037580 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-d3c7ce69-b3bd-4aa4-b930-8e9798114edd tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Request method failure captured: Jun 25 16:11:01.037580 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: request: GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 HTTP/1.1 Jun 25 16:11:01.037580 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept: application/json Jun 25 16:11:01.037580 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept-Encoding: identity Jun 25 16:11:01.037580 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Connection: close Jun 25 16:11:01.037580 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Length: 0 Jun 25 16:11:01.037580 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Type: application/json Jun 25 16:11:01.037580 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Host: 10.222.0.13 Jun 25 16:11:01.037580 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Openstack-System-Scope: None Jun 25 16:11:01.037580 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: User-Agent: python-urllib3/1.26.9 Jun 25 16:11:01.037580 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Auth-Token: gAAAAABitzJ4VTX9FBO09dP9eDUNJ7kXDvOeQ_3800jobL_5yAtOgxQI54WUI0jlTKIeeP5rTVj0MTWBlkUxqhr419kWtC1O7I2ACk-hIdi2fMzwDg3khIX53lL7PAAWZJjGvTHF0eyDgeSSmpMCdU8rbC_7cLecxR6vp9KZlm3nwM3ZTo0XAYY Jun 25 16:11:01.037580 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Id: None Jun 25 16:11:01.037580 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Name: None Jun 25 16:11:01.037580 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Identity-Status: Confirmed Jun 25 16:11:01.037580 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Is-Admin-Project: True Jun 25 16:11:01.037580 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Id: default Jun 25 16:11:01.037580 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Name: Default Jun 25 16:11:01.037580 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Id: b1bba8f74dbd433bbffdb2ffbfc481fb Jun 25 16:11:01.037580 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Name: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:11:01.037580 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Role: reader,member Jun 25 16:11:01.037580 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Roles: reader,member Jun 25 16:11:01.039187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b1bba8f74dbd433bbffdb2ffbfc481fb", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:11:01.039187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:11:01.039187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Id: b1bba8f74dbd433bbffdb2ffbfc481fb Jun 25 16:11:01.039187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:11:01.039187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User: tempest-AttachVolumeNegativeTest-1137598465-project Jun 25 16:11:01.039187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Id: default Jun 25 16:11:01.039187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Name: Default Jun 25 16:11:01.039187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Id: 19140330ae664e45b85f47f321496191 Jun 25 16:11:01.039187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Name: tempest-AttachVolumeNegativeTest-1137598465-project Jun 25 16:11:01.039187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: method: > Jun 25 16:11:01.039187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: exception: Instance b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 could not be found. Jun 25 16:11:01.039187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: action_args: {'id': 'b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9'} Jun 25 16:11:01.040090 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:11:01.040090 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:11:01.040090 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:11:01.040090 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:11:01.040090 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:11:01.040090 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:11:01.040090 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:11:01.040090 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:11:01.040090 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:11:01.040090 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:11:01.040090 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 could not be found. Jun 25 16:11:01.040090 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:11:01.040090 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:11:01.040090 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:11:01.040090 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:11:01.040090 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:11:01.040090 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:11:01.040090 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:11:01.040090 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:11:01.040090 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:11:01.041508 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:11:01.041508 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 16:11:01.041508 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 16:11:01.041508 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:11:01.041508 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:11:01.041508 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:11:01.041508 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:11:01.041508 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 could not be found. Jun 25 16:11:01.041508 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:11:01.041508 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:11:01.041508 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:11:01.041508 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:11:01.041508 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:11:01.041508 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:11:01.041508 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:11:01.041508 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:11:01.041508 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 could not be found. Jun 25 16:11:01.041508 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:11:01.043004 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-d3c7ce69-b3bd-4aa4-b930-8e9798114edd tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Returning 404 to user: Instance b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 could not be found. {{(pid=117794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:11:01.043004 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-d3c7ce69-b3bd-4aa4-b930-8e9798114edd tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9" status: 404 len: 111 microversion: 2.1 time: 0.031628 Jun 25 16:11:01.043004 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 268/540] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:01 2022] GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:11:01.049037 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1c7a5eb1-8429-47e0-8ffa-2953241fa5f6 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '.version_select at 0x7f65bb77edc0>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:01.069512 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1c7a5eb1-8429-47e0-8ffa-2953241fa5f6 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-88150719" status: 202 len: 0 microversion: 2.1 time: 0.024699 Jun 25 16:11:01.070104 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 273/541] 10.222.0.13 () {58 vars in 1214 bytes} [Sat Jun 25 16:11:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-88150719 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 16:11:01.712820 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-38099be5-1237-4a62-9bb9-07949c958865 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Action: 'create', calling method: .version_select at 0x7f65bb594700>, body: {"keypair": {"name": "tempest-keypair-59998206", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEHxNgxa7C/CUQz4zJuR0yo0fPO+QvGxqQQF0PWHbjUxfGc4C+YHHmhxJGnyzRZeFvILTrKFrH6xaEhgb9nhXN458iFNb39rUfvpuSu8OK5IHGSdm7Rc5JCMDfc+2vNQw=="}} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:11:01.727578 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.quota [None req-38099be5-1237-4a62-9bb9-07949c958865 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Getting quotas for project b1bba8f74dbd433bbffdb2ffbfc481fb. Resources: {'key_pairs'} {{(pid=117794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:11:01.731551 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.quota [None req-38099be5-1237-4a62-9bb9-07949c958865 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Getting quotas for user 19140330ae664e45b85f47f321496191 and project b1bba8f74dbd433bbffdb2ffbfc481fb. Resources: {'key_pairs'} {{(pid=117794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:11:01.755124 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-38099be5-1237-4a62-9bb9-07949c958865 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.046400 Jun 25 16:11:01.755739 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 269/542] 10.222.0.13 () {60 vars in 1158 bytes} [Sat Jun 25 16:11:01 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:11:03.061672 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a3245689-ec1d-4abd-bfc9-1b090b561c72 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2028680774", "imageRef": "84c164fa-276d-4693-b7a0-24fd3024b359", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "92184934-9929-49a5-91f4-1ab03b25e2f1"}], "security_groups": [{"name": "tempest-securitygroup--143786643"}], "key_name": "tempest-keypair-59998206", "user_data": "}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:11:03.342628 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-a3245689-ec1d-4abd-bfc9-1b090b561c72 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] validate_networks() for [('92184934-9929-49a5-91f4-1ab03b25e2f1', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 16:11:03.729915 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-a3245689-ec1d-4abd-bfc9-1b090b561c72 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 16:11:03.730332 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-a3245689-ec1d-4abd-bfc9-1b090b561c72 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 16:11:03.730796 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-a3245689-ec1d-4abd-bfc9-1b090b561c72 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 16:11:03.731195 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-a3245689-ec1d-4abd-bfc9-1b090b561c72 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 16:11:03.731596 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-a3245689-ec1d-4abd-bfc9-1b090b561c72 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 16:11:03.742041 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a3245689-ec1d-4abd-bfc9-1b090b561c72 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:03.742480 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a3245689-ec1d-4abd-bfc9-1b090b561c72 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:03.743267 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a3245689-ec1d-4abd-bfc9-1b090b561c72 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:03.743693 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a3245689-ec1d-4abd-bfc9-1b090b561c72 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:03.761361 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-a3245689-ec1d-4abd-bfc9-1b090b561c72 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Getting quotas for project b1bba8f74dbd433bbffdb2ffbfc481fb. Resources: {'ram', 'cores', 'instances'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:11:03.765976 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-a3245689-ec1d-4abd-bfc9-1b090b561c72 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Getting quotas for user 19140330ae664e45b85f47f321496191 and project b1bba8f74dbd433bbffdb2ffbfc481fb. Resources: {'ram', 'cores', 'instances'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:11:03.778358 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a3245689-ec1d-4abd-bfc9-1b090b561c72 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 16:11:03.780756 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a3245689-ec1d-4abd-bfc9-1b090b561c72 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 2db6cecf-c268-4ee6-a745-6e2130e594bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84c164fa-276d-4693-b7a0-24fd3024b359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 16:11:03.829763 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a3245689-ec1d-4abd-bfc9-1b090b561c72 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.772420 Jun 25 16:11:03.830546 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 274/543] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Jun 25 16:11:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 16:11:03.841669 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-6876cad8-10ad-446b-b76a-f5448b03502a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:03.842407 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-6876cad8-10ad-446b-b76a-f5448b03502a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 2db6cecf-c268-4ee6-a745-6e2130e594bb] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:03.902098 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-6876cad8-10ad-446b-b76a-f5448b03502a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:03.909260 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-6876cad8-10ad-446b-b76a-f5448b03502a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb" status: 200 len: 1240 microversion: 2.1 time: 0.072461 Jun 25 16:11:03.909820 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 270/544] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:03 2022] GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb => generated 1240 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:04.926909 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-fce67746-f1f3-4061-8cf1-04d40b452913 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:04.928141 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-fce67746-f1f3-4061-8cf1-04d40b452913 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 2db6cecf-c268-4ee6-a745-6e2130e594bb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:04.934628 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fce67746-f1f3-4061-8cf1-04d40b452913 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:04.935228 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fce67746-f1f3-4061-8cf1-04d40b452913 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:04.936112 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fce67746-f1f3-4061-8cf1-04d40b452913 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:04.936585 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fce67746-f1f3-4061-8cf1-04d40b452913 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:04.999486 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fce67746-f1f3-4061-8cf1-04d40b452913 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:05.007361 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-fce67746-f1f3-4061-8cf1-04d40b452913 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb" status: 200 len: 1298 microversion: 2.1 time: 0.085270 Jun 25 16:11:05.007924 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 275/545] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:04 2022] GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb => generated 1298 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:06.024907 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-d69b3242-710d-4127-a017-ea8ec8adf595 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:06.025485 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-d69b3242-710d-4127-a017-ea8ec8adf595 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 2db6cecf-c268-4ee6-a745-6e2130e594bb] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:06.031985 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d69b3242-710d-4127-a017-ea8ec8adf595 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:06.032641 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d69b3242-710d-4127-a017-ea8ec8adf595 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:06.033286 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d69b3242-710d-4127-a017-ea8ec8adf595 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:06.033718 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d69b3242-710d-4127-a017-ea8ec8adf595 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:06.167374 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d69b3242-710d-4127-a017-ea8ec8adf595 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:06.175290 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-d69b3242-710d-4127-a017-ea8ec8adf595 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb" status: 200 len: 1365 microversion: 2.1 time: 0.154178 Jun 25 16:11:06.175866 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 271/546] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:06 2022] GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:06.429398 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-fea04424-15bd-435c-bd78-835f843ef38e req-96a8fd1d-b72a-491c-af0b-90d41ad58ce2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2db6cecf-c268-4ee6-a745-6e2130e594bb", "tag": "172ac5a0-4d98-42ad-b245-4ffe24d39dde"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:11:06.440527 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-fea04424-15bd-435c-bd78-835f843ef38e req-96a8fd1d-b72a-491c-af0b-90d41ad58ce2 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:06.441006 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-fea04424-15bd-435c-bd78-835f843ef38e req-96a8fd1d-b72a-491c-af0b-90d41ad58ce2 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:06.454033 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-fea04424-15bd-435c-bd78-835f843ef38e req-96a8fd1d-b72a-491c-af0b-90d41ad58ce2 service nova] Creating event network-changed:172ac5a0-4d98-42ad-b245-4ffe24d39dde for instance 2db6cecf-c268-4ee6-a745-6e2130e594bb on hv-cinder-84762 Jun 25 16:11:06.460089 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-fea04424-15bd-435c-bd78-835f843ef38e req-96a8fd1d-b72a-491c-af0b-90d41ad58ce2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034508 Jun 25 16:11:06.460785 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 276/547] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:11:07.196390 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-676de14a-3726-4e4a-adb3-212c2da5b8e4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:07.197412 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-676de14a-3726-4e4a-adb3-212c2da5b8e4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 2db6cecf-c268-4ee6-a745-6e2130e594bb] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:07.208269 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-676de14a-3726-4e4a-adb3-212c2da5b8e4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:07.209069 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-676de14a-3726-4e4a-adb3-212c2da5b8e4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:07.210312 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-676de14a-3726-4e4a-adb3-212c2da5b8e4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:07.211040 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-676de14a-3726-4e4a-adb3-212c2da5b8e4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:07.460864 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-676de14a-3726-4e4a-adb3-212c2da5b8e4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:07.472613 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-676de14a-3726-4e4a-adb3-212c2da5b8e4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb" status: 200 len: 1365 microversion: 2.1 time: 0.282261 Jun 25 16:11:07.473388 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 272/548] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:07 2022] GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb => generated 1365 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:08.499531 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c4fae2b5-84ec-45c4-9804-1c5a30440915 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:08.501090 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c4fae2b5-84ec-45c4-9804-1c5a30440915 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 2db6cecf-c268-4ee6-a745-6e2130e594bb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:08.512638 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c4fae2b5-84ec-45c4-9804-1c5a30440915 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:08.513374 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c4fae2b5-84ec-45c4-9804-1c5a30440915 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:08.514974 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c4fae2b5-84ec-45c4-9804-1c5a30440915 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:08.515688 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c4fae2b5-84ec-45c4-9804-1c5a30440915 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:08.649541 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c4fae2b5-84ec-45c4-9804-1c5a30440915 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:08.657281 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c4fae2b5-84ec-45c4-9804-1c5a30440915 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb" status: 200 len: 1365 microversion: 2.1 time: 0.164873 Jun 25 16:11:08.657878 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 277/549] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:08 2022] GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb => generated 1365 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:09.129770 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-78620592-ec63-4e33-a321-3a9973cd4cad tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:09.130316 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-78620592-ec63-4e33-a321-3a9973cd4cad tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:09.136664 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-78620592-ec63-4e33-a321-3a9973cd4cad tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:09.137118 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-78620592-ec63-4e33-a321-3a9973cd4cad tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:09.137884 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-78620592-ec63-4e33-a321-3a9973cd4cad tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:09.138321 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-78620592-ec63-4e33-a321-3a9973cd4cad tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:09.224156 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.objects.instance [None req-78620592-ec63-4e33-a321-3a9973cd4cad tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lazy-loading 'services' on Instance uuid 8de27285-8f18-4d98-b240-0042e68f7ff9 {{(pid=117794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 16:11:09.308085 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-78620592-ec63-4e33-a321-3a9973cd4cad tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9/os-volume_attachments/c7a77e46-f8e7-4dad-b3d5-9b120e204547" status: 202 len: 0 microversion: 2.1 time: 0.182601 Jun 25 16:11:09.309094 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 273/550] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Jun 25 16:11:09 2022] DELETE /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9/os-volume_attachments/c7a77e46-f8e7-4dad-b3d5-9b120e204547 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 16:11:09.318331 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d0081013-0433-4cf4-a9c3-c8486e62d8cb tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:09.319362 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d0081013-0433-4cf4-a9c3-c8486e62d8cb tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:09.325747 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d0081013-0433-4cf4-a9c3-c8486e62d8cb tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:09.326252 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d0081013-0433-4cf4-a9c3-c8486e62d8cb tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:09.327197 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d0081013-0433-4cf4-a9c3-c8486e62d8cb tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:09.327705 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d0081013-0433-4cf4-a9c3-c8486e62d8cb tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:09.358298 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d0081013-0433-4cf4-a9c3-c8486e62d8cb tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043924 Jun 25 16:11:09.358840 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 278/551] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Jun 25 16:11:09 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:11:09.674325 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-187c4032-fb0d-48cc-a13e-4f1e41564a3d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:09.675023 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-187c4032-fb0d-48cc-a13e-4f1e41564a3d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 2db6cecf-c268-4ee6-a745-6e2130e594bb] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:09.681770 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-187c4032-fb0d-48cc-a13e-4f1e41564a3d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:09.682220 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-187c4032-fb0d-48cc-a13e-4f1e41564a3d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:09.682985 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-187c4032-fb0d-48cc-a13e-4f1e41564a3d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:09.683411 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-187c4032-fb0d-48cc-a13e-4f1e41564a3d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:09.816594 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-187c4032-fb0d-48cc-a13e-4f1e41564a3d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:09.824175 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-187c4032-fb0d-48cc-a13e-4f1e41564a3d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb" status: 200 len: 1365 microversion: 2.1 time: 0.154107 Jun 25 16:11:09.824762 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 274/552] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:09 2022] GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:10.478542 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-df1d8df0-6a1e-4ae4-85ec-bdc746657460 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:10.479462 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-df1d8df0-6a1e-4ae4-85ec-bdc746657460 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:10.485764 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-df1d8df0-6a1e-4ae4-85ec-bdc746657460 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:10.486205 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-df1d8df0-6a1e-4ae4-85ec-bdc746657460 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:10.486952 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-df1d8df0-6a1e-4ae4-85ec-bdc746657460 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:10.487383 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-df1d8df0-6a1e-4ae4-85ec-bdc746657460 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:10.516793 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-df1d8df0-6a1e-4ae4-85ec-bdc746657460 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.150141 Jun 25 16:11:10.517337 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 279/553] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Jun 25 16:11:10 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9/os-volume_attachments => generated 25 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 16:11:10.601484 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-3f3f156e-3f88-49c0-ae77-2505470b84f5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:10.602024 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-3f3f156e-3f88-49c0-ae77-2505470b84f5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:10.608954 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3f3f156e-3f88-49c0-ae77-2505470b84f5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:10.609384 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3f3f156e-3f88-49c0-ae77-2505470b84f5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:10.610259 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3f3f156e-3f88-49c0-ae77-2505470b84f5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:10.610692 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3f3f156e-3f88-49c0-ae77-2505470b84f5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:10.635329 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-3f3f156e-3f88-49c0-ae77-2505470b84f5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Going to try to terminate instance {{(pid=117794) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 16:11:10.724418 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-3f3f156e-3f88-49c0-ae77-2505470b84f5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 204 len: 0 microversion: 2.1 time: 0.126480 Jun 25 16:11:10.725057 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 275/554] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Jun 25 16:11:10 2022] DELETE /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 16:11:10.734737 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ea131cc5-a8ca-4bb9-ab66-8f0305b02f23 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:10.735341 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ea131cc5-a8ca-4bb9-ab66-8f0305b02f23 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:10.741962 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ea131cc5-a8ca-4bb9-ab66-8f0305b02f23 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:10.742403 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ea131cc5-a8ca-4bb9-ab66-8f0305b02f23 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:10.743235 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ea131cc5-a8ca-4bb9-ab66-8f0305b02f23 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:10.743660 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ea131cc5-a8ca-4bb9-ab66-8f0305b02f23 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:10.841525 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-21aed19c-9595-4c70-ba0f-2ea5b50a38a4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:10.842477 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-21aed19c-9595-4c70-ba0f-2ea5b50a38a4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 2db6cecf-c268-4ee6-a745-6e2130e594bb] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:10.848961 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-21aed19c-9595-4c70-ba0f-2ea5b50a38a4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:10.849415 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-21aed19c-9595-4c70-ba0f-2ea5b50a38a4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:10.850183 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-21aed19c-9595-4c70-ba0f-2ea5b50a38a4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:10.850624 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-21aed19c-9595-4c70-ba0f-2ea5b50a38a4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:10.904105 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ea131cc5-a8ca-4bb9-ab66-8f0305b02f23 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:10.912292 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ea131cc5-a8ca-4bb9-ab66-8f0305b02f23 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1687 microversion: 2.1 time: 0.182768 Jun 25 16:11:10.912911 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 280/555] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:10 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1687 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:11:10.993355 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-21aed19c-9595-4c70-ba0f-2ea5b50a38a4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:11.001953 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-21aed19c-9595-4c70-ba0f-2ea5b50a38a4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb" status: 200 len: 1365 microversion: 2.1 time: 0.164688 Jun 25 16:11:11.002536 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 276/556] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:10 2022] GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:11:11.664246 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-ff049c24-7565-472d-96f3-1efee3207add req-a870430e-1151-422b-a684-9e99047976b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2db6cecf-c268-4ee6-a745-6e2130e594bb", "name": "network-vif-plugged", "status": "completed", "tag": "172ac5a0-4d98-42ad-b245-4ffe24d39dde"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:11:11.674301 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-ff049c24-7565-472d-96f3-1efee3207add req-a870430e-1151-422b-a684-9e99047976b8 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:11.674877 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-ff049c24-7565-472d-96f3-1efee3207add req-a870430e-1151-422b-a684-9e99047976b8 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:11.687421 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-ff049c24-7565-472d-96f3-1efee3207add req-a870430e-1151-422b-a684-9e99047976b8 service nova] Creating event network-vif-plugged:172ac5a0-4d98-42ad-b245-4ffe24d39dde for instance 2db6cecf-c268-4ee6-a745-6e2130e594bb on hv-cinder-84762 Jun 25 16:11:11.692274 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-ff049c24-7565-472d-96f3-1efee3207add req-a870430e-1151-422b-a684-9e99047976b8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031773 Jun 25 16:11:11.693308 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 281/557] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:11:11.934012 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-5e5076f5-a312-4e20-b1b0-e0b9871dc633 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:11.935029 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-5e5076f5-a312-4e20-b1b0-e0b9871dc633 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:11.943699 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5e5076f5-a312-4e20-b1b0-e0b9871dc633 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:11.944160 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5e5076f5-a312-4e20-b1b0-e0b9871dc633 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:11.944968 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5e5076f5-a312-4e20-b1b0-e0b9871dc633 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:11.945394 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5e5076f5-a312-4e20-b1b0-e0b9871dc633 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:12.027550 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7321aeb2-f174-4d79-abb6-dff14d005055 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:12.028246 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7321aeb2-f174-4d79-abb6-dff14d005055 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 2db6cecf-c268-4ee6-a745-6e2130e594bb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:12.035860 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7321aeb2-f174-4d79-abb6-dff14d005055 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:12.036312 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7321aeb2-f174-4d79-abb6-dff14d005055 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:12.037100 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7321aeb2-f174-4d79-abb6-dff14d005055 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:12.037533 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7321aeb2-f174-4d79-abb6-dff14d005055 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:12.120742 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-5e5076f5-a312-4e20-b1b0-e0b9871dc633 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:12.124286 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:11:12.130174 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-5e5076f5-a312-4e20-b1b0-e0b9871dc633 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1687 microversion: 2.1 time: 0.203042 Jun 25 16:11:12.130765 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 277/558] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:11 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1687 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:12.188049 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7321aeb2-f174-4d79-abb6-dff14d005055 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:12.198719 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7321aeb2-f174-4d79-abb6-dff14d005055 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb" status: 200 len: 1365 microversion: 2.1 time: 0.175204 Jun 25 16:11:12.199282 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 282/559] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:12 2022] GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:11:12.671408 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-a5d93782-baeb-49ce-9959-5d6a98412c00 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:12.672039 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-a5d93782-baeb-49ce-9959-5d6a98412c00 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:12.683915 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a5d93782-baeb-49ce-9959-5d6a98412c00 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:12.684713 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a5d93782-baeb-49ce-9959-5d6a98412c00 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:12.685968 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a5d93782-baeb-49ce-9959-5d6a98412c00 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:12.686701 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a5d93782-baeb-49ce-9959-5d6a98412c00 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:12.717328 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-a5d93782-baeb-49ce-9959-5d6a98412c00 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec/os-volume_attachments/ec22cfe9-2f73-4019-8975-6f7cea545a9a" status: 200 len: 194 microversion: 2.20 time: 0.052859 Jun 25 16:11:12.717899 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 278/560] 10.222.0.13 () {60 vars in 1453 bytes} [Sat Jun 25 16:11:12 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec/os-volume_attachments/ec22cfe9-2f73-4019-8975-6f7cea545a9a => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 16:11:12.784583 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-44403a4e-c15d-4891-809c-265fbdb65522 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:12.785112 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-44403a4e-c15d-4891-809c-265fbdb65522 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:12.791656 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-44403a4e-c15d-4891-809c-265fbdb65522 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:12.792093 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-44403a4e-c15d-4891-809c-265fbdb65522 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:12.792874 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-44403a4e-c15d-4891-809c-265fbdb65522 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:12.793334 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-44403a4e-c15d-4891-809c-265fbdb65522 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:12.874533 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-44403a4e-c15d-4891-809c-265fbdb65522 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lazy-loading 'services' on Instance uuid e6ae5a58-db83-401e-a158-ebf0981e84ec {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 16:11:12.959216 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-44403a4e-c15d-4891-809c-265fbdb65522 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec/os-volume_attachments/ec22cfe9-2f73-4019-8975-6f7cea545a9a" status: 202 len: 0 microversion: 2.20 time: 0.178555 Jun 25 16:11:12.959829 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 283/561] 10.222.0.13 () {60 vars in 1456 bytes} [Sat Jun 25 16:11:12 2022] DELETE /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec/os-volume_attachments/ec22cfe9-2f73-4019-8975-6f7cea545a9a => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 25 16:11:12.968278 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-a7c92fbc-fdd5-4e0c-aec3-c5b24f87926f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:12.969359 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-a7c92fbc-fdd5-4e0c-aec3-c5b24f87926f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:12.976113 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a7c92fbc-fdd5-4e0c-aec3-c5b24f87926f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:12.976618 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a7c92fbc-fdd5-4e0c-aec3-c5b24f87926f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:12.977414 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a7c92fbc-fdd5-4e0c-aec3-c5b24f87926f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:12.977853 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a7c92fbc-fdd5-4e0c-aec3-c5b24f87926f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:13.006781 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-a7c92fbc-fdd5-4e0c-aec3-c5b24f87926f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042421 Jun 25 16:11:13.007305 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 279/562] 10.222.0.13 () {60 vars in 1342 bytes} [Sat Jun 25 16:11:12 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 16:11:13.154613 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-671658d3-7d41-4a96-83ad-73e4d4317b3a tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:13.155748 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-671658d3-7d41-4a96-83ad-73e4d4317b3a tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:13.163400 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-671658d3-7d41-4a96-83ad-73e4d4317b3a tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:13.163847 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-671658d3-7d41-4a96-83ad-73e4d4317b3a tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:13.164661 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-671658d3-7d41-4a96-83ad-73e4d4317b3a tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:13.165094 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-671658d3-7d41-4a96-83ad-73e4d4317b3a tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:13.218415 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-453b5ec8-2f4c-4809-af9a-7e02102e75d1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:13.219352 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-453b5ec8-2f4c-4809-af9a-7e02102e75d1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 2db6cecf-c268-4ee6-a745-6e2130e594bb] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:13.225518 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-453b5ec8-2f4c-4809-af9a-7e02102e75d1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:13.225976 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-453b5ec8-2f4c-4809-af9a-7e02102e75d1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:13.226781 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-453b5ec8-2f4c-4809-af9a-7e02102e75d1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:13.227219 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-453b5ec8-2f4c-4809-af9a-7e02102e75d1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:13.359356 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-671658d3-7d41-4a96-83ad-73e4d4317b3a tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:13.368016 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-671658d3-7d41-4a96-83ad-73e4d4317b3a tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1687 microversion: 2.1 time: 0.220507 Jun 25 16:11:13.368839 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 284/563] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:13 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1687 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:13.385047 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-453b5ec8-2f4c-4809-af9a-7e02102e75d1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:13.393192 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-453b5ec8-2f4c-4809-af9a-7e02102e75d1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb" status: 200 len: 1365 microversion: 2.1 time: 0.179900 Jun 25 16:11:13.393757 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 280/564] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:13 2022] GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb => generated 1365 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:13.951394 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-0c0db099-b19e-46d6-ad94-236644a4804c tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:11:13.952239 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0c0db099-b19e-46d6-ad94-236644a4804c tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:13.955609 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:11:13.956739 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=6 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:11:13.966772 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0c0db099-b19e-46d6-ad94-236644a4804c tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:13.967561 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0c0db099-b19e-46d6-ad94-236644a4804c tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:13.968870 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0c0db099-b19e-46d6-ad94-236644a4804c tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:13.969564 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0c0db099-b19e-46d6-ad94-236644a4804c tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:13.973479 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:11:13.994787 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-0c0db099-b19e-46d6-ad94-236644a4804c tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lazy-loading 'flavor' on Instance uuid affce264-2942-4aa8-850e-96642d84eff3 {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 16:11:14.020827 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-0cfa752d-c410-4ef5-8f72-0a19597cf10c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:14.022187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-0cfa752d-c410-4ef5-8f72-0a19597cf10c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:14.024376 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell0:SELECT=6 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:11:14.033473 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0cfa752d-c410-4ef5-8f72-0a19597cf10c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:14.034251 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0cfa752d-c410-4ef5-8f72-0a19597cf10c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:14.035100 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0cfa752d-c410-4ef5-8f72-0a19597cf10c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:14.035878 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0cfa752d-c410-4ef5-8f72-0a19597cf10c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:14.070153 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-0cfa752d-c410-4ef5-8f72-0a19597cf10c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055359 Jun 25 16:11:14.071558 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 281/565] 10.222.0.13 () {60 vars in 1342 bytes} [Sat Jun 25 16:11:14 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 16:11:14.105403 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-0c0db099-b19e-46d6-ad94-236644a4804c tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "POST /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3/action" status: 202 len: 0 microversion: 2.1 time: 0.160553 Jun 25 16:11:14.106002 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 285/566] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Jun 25 16:11:13 2022] POST /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 16:11:14.114194 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-081453eb-52d2-4a1e-adb7-ee020d3f2dd7 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:14.114709 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-081453eb-52d2-4a1e-adb7-ee020d3f2dd7 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:14.121230 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-081453eb-52d2-4a1e-adb7-ee020d3f2dd7 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:14.121709 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-081453eb-52d2-4a1e-adb7-ee020d3f2dd7 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:14.122470 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-081453eb-52d2-4a1e-adb7-ee020d3f2dd7 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:14.122902 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-081453eb-52d2-4a1e-adb7-ee020d3f2dd7 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:14.386124 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e0f8296c-5f5b-4f4b-9959-91f5b2a693a2 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:14.386849 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e0f8296c-5f5b-4f4b-9959-91f5b2a693a2 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:14.393413 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0f8296c-5f5b-4f4b-9959-91f5b2a693a2 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:14.393860 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0f8296c-5f5b-4f4b-9959-91f5b2a693a2 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:14.394621 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0f8296c-5f5b-4f4b-9959-91f5b2a693a2 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:14.395050 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0f8296c-5f5b-4f4b-9959-91f5b2a693a2 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:14.414923 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-081453eb-52d2-4a1e-adb7-ee020d3f2dd7 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:14.423599 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-081453eb-52d2-4a1e-adb7-ee020d3f2dd7 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1569 microversion: 2.1 time: 0.313260 Jun 25 16:11:14.433732 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 282/567] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:14 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1569 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:14.438663 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-b7f99702-759a-409c-9ea0-5cf80ee19cb7 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:14.439292 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-b7f99702-759a-409c-9ea0-5cf80ee19cb7 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 2db6cecf-c268-4ee6-a745-6e2130e594bb] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:14.445639 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b7f99702-759a-409c-9ea0-5cf80ee19cb7 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:14.446090 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b7f99702-759a-409c-9ea0-5cf80ee19cb7 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:14.447072 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b7f99702-759a-409c-9ea0-5cf80ee19cb7 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:14.447502 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b7f99702-759a-409c-9ea0-5cf80ee19cb7 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:14.712324 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e0f8296c-5f5b-4f4b-9959-91f5b2a693a2 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:14.720553 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e0f8296c-5f5b-4f4b-9959-91f5b2a693a2 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1687 microversion: 2.1 time: 0.338648 Jun 25 16:11:14.721135 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 286/568] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:14 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1687 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:11:14.738675 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-b7f99702-759a-409c-9ea0-5cf80ee19cb7 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:14.746373 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-b7f99702-759a-409c-9ea0-5cf80ee19cb7 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb" status: 200 len: 1365 microversion: 2.1 time: 0.311476 Jun 25 16:11:14.747252 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 283/569] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:14 2022] GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb => generated 1365 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:15.082606 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e7b10daa-9c2e-48b9-a009-27974eab98f6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:15.083585 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e7b10daa-9c2e-48b9-a009-27974eab98f6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:15.090541 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e7b10daa-9c2e-48b9-a009-27974eab98f6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:15.091007 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e7b10daa-9c2e-48b9-a009-27974eab98f6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:15.091738 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e7b10daa-9c2e-48b9-a009-27974eab98f6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:15.092165 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e7b10daa-9c2e-48b9-a009-27974eab98f6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:15.122803 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e7b10daa-9c2e-48b9-a009-27974eab98f6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044463 Jun 25 16:11:15.123377 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 287/570] 10.222.0.13 () {60 vars in 1342 bytes} [Sat Jun 25 16:11:15 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:15.185950 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-df5ea6a3-3057-48fc-a212-761576140160 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:15.186441 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-df5ea6a3-3057-48fc-a212-761576140160 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:15.193302 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-df5ea6a3-3057-48fc-a212-761576140160 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:15.193755 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-df5ea6a3-3057-48fc-a212-761576140160 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:15.194528 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-df5ea6a3-3057-48fc-a212-761576140160 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:15.194937 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-df5ea6a3-3057-48fc-a212-761576140160 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:15.231604 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-4784be0b-7ad7-4982-b85a-0168f15fefef req-7a6c618e-ece2-459a-96b6-5f99b3c8c801 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8de27285-8f18-4d98-b240-0042e68f7ff9", "name": "network-vif-deleted", "tag": "17f4711f-55ed-463b-986b-2d3077795600"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:11:15.235717 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-df5ea6a3-3057-48fc-a212-761576140160 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Going to try to terminate instance {{(pid=117794) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 16:11:15.249605 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-4784be0b-7ad7-4982-b85a-0168f15fefef req-7a6c618e-ece2-459a-96b6-5f99b3c8c801 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:15.250400 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-4784be0b-7ad7-4982-b85a-0168f15fefef req-7a6c618e-ece2-459a-96b6-5f99b3c8c801 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:15.269671 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-4784be0b-7ad7-4982-b85a-0168f15fefef req-7a6c618e-ece2-459a-96b6-5f99b3c8c801 service nova] Creating event network-vif-deleted:17f4711f-55ed-463b-986b-2d3077795600 for instance 8de27285-8f18-4d98-b240-0042e68f7ff9 on hv-cinder-84762 Jun 25 16:11:15.274472 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-4784be0b-7ad7-4982-b85a-0168f15fefef req-7a6c618e-ece2-459a-96b6-5f99b3c8c801 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046579 Jun 25 16:11:15.275073 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 288/571] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:11:15.345373 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-df5ea6a3-3057-48fc-a212-761576140160 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 204 len: 0 microversion: 2.20 time: 0.162295 Jun 25 16:11:15.349308 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 284/572] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Jun 25 16:11:15 2022] DELETE /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 25 16:11:15.355065 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-379696e3-5de3-4037-9c5a-9bb61994860d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:15.355760 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-379696e3-5de3-4037-9c5a-9bb61994860d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:15.362221 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-379696e3-5de3-4037-9c5a-9bb61994860d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:15.362899 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-379696e3-5de3-4037-9c5a-9bb61994860d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:15.363661 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-379696e3-5de3-4037-9c5a-9bb61994860d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:15.364088 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-379696e3-5de3-4037-9c5a-9bb61994860d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:15.446215 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-2a186177-fbef-4b2d-9e1c-3592cdfd66b5 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:15.447379 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-2a186177-fbef-4b2d-9e1c-3592cdfd66b5 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:15.455461 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2a186177-fbef-4b2d-9e1c-3592cdfd66b5 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:15.456116 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2a186177-fbef-4b2d-9e1c-3592cdfd66b5 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:15.457620 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2a186177-fbef-4b2d-9e1c-3592cdfd66b5 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:15.458055 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2a186177-fbef-4b2d-9e1c-3592cdfd66b5 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:15.547420 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-379696e3-5de3-4037-9c5a-9bb61994860d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:15.556300 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-379696e3-5de3-4037-9c5a-9bb61994860d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:15.557858 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-379696e3-5de3-4037-9c5a-9bb61994860d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:15.559007 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-379696e3-5de3-4037-9c5a-9bb61994860d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1723 microversion: 2.20 time: 0.208299 Jun 25 16:11:15.559555 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 289/573] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:11:15 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1723 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:11:15.620623 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-2a186177-fbef-4b2d-9e1c-3592cdfd66b5 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:15.635248 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-2a186177-fbef-4b2d-9e1c-3592cdfd66b5 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1569 microversion: 2.1 time: 0.195042 Jun 25 16:11:15.641305 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 285/574] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:15 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1569 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:15.738233 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b3b7436c-55bd-4424-aab0-30f87ac9b052 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:15.738746 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b3b7436c-55bd-4424-aab0-30f87ac9b052 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:15.744778 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b3b7436c-55bd-4424-aab0-30f87ac9b052 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:15.745222 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b3b7436c-55bd-4424-aab0-30f87ac9b052 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:15.745981 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b3b7436c-55bd-4424-aab0-30f87ac9b052 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:15.746412 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b3b7436c-55bd-4424-aab0-30f87ac9b052 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:15.778468 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b3b7436c-55bd-4424-aab0-30f87ac9b052 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:15.778939 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b3b7436c-55bd-4424-aab0-30f87ac9b052 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:15.779384 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-b3b7436c-55bd-4424-aab0-30f87ac9b052 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lazy-loading 'fault' on Instance uuid 8de27285-8f18-4d98-b240-0042e68f7ff9 {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 16:11:15.834122 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b3b7436c-55bd-4424-aab0-30f87ac9b052 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:15.842096 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-9f4645d7-696a-401c-814c-fbf23351e1c4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:15.842258 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b3b7436c-55bd-4424-aab0-30f87ac9b052 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1334 microversion: 2.1 time: 0.108035 Jun 25 16:11:15.842701 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-9f4645d7-696a-401c-814c-fbf23351e1c4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 2db6cecf-c268-4ee6-a745-6e2130e594bb] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:15.849021 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9f4645d7-696a-401c-814c-fbf23351e1c4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:15.849472 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9f4645d7-696a-401c-814c-fbf23351e1c4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:15.850647 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9f4645d7-696a-401c-814c-fbf23351e1c4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:15.850783 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9f4645d7-696a-401c-814c-fbf23351e1c4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:15.851825 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 290/575] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:15 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1334 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:15.996178 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-9f4645d7-696a-401c-814c-fbf23351e1c4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:16.004556 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-9f4645d7-696a-401c-814c-fbf23351e1c4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb" status: 200 len: 1556 microversion: 2.1 time: 0.245274 Jun 25 16:11:16.005116 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 286/576] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:15 2022] GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb => generated 1556 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:16.021579 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4fda723c-525c-4969-b32d-3acead80530d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:16.022066 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4fda723c-525c-4969-b32d-3acead80530d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 2db6cecf-c268-4ee6-a745-6e2130e594bb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:16.028381 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4fda723c-525c-4969-b32d-3acead80530d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:16.028856 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4fda723c-525c-4969-b32d-3acead80530d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:16.029638 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4fda723c-525c-4969-b32d-3acead80530d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:16.030066 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4fda723c-525c-4969-b32d-3acead80530d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:16.108550 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4fda723c-525c-4969-b32d-3acead80530d tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090885 Jun 25 16:11:16.109495 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 291/577] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Jun 25 16:11:16 2022] GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:11:16.578931 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-92351c9a-f6fe-414f-a421-1225166fa3b4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:16.579522 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-92351c9a-f6fe-414f-a421-1225166fa3b4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:16.586570 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-92351c9a-f6fe-414f-a421-1225166fa3b4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:16.586994 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-92351c9a-f6fe-414f-a421-1225166fa3b4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:16.587797 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-92351c9a-f6fe-414f-a421-1225166fa3b4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:16.588232 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-92351c9a-f6fe-414f-a421-1225166fa3b4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:16.654634 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f3a5e2f5-21a1-4ff4-b9d0-4fab855089a5 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:16.655133 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f3a5e2f5-21a1-4ff4-b9d0-4fab855089a5 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:16.661817 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f3a5e2f5-21a1-4ff4-b9d0-4fab855089a5 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:16.662275 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f3a5e2f5-21a1-4ff4-b9d0-4fab855089a5 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:16.663045 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f3a5e2f5-21a1-4ff4-b9d0-4fab855089a5 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:16.663482 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f3a5e2f5-21a1-4ff4-b9d0-4fab855089a5 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:17.147724 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-92351c9a-f6fe-414f-a421-1225166fa3b4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:17.157050 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-92351c9a-f6fe-414f-a421-1225166fa3b4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:17.159061 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-92351c9a-f6fe-414f-a421-1225166fa3b4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:17.160111 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-92351c9a-f6fe-414f-a421-1225166fa3b4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1723 microversion: 2.20 time: 0.585301 Jun 25 16:11:17.160704 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 287/578] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:11:16 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1723 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:11:17.167937 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-9d942835-6f93-451e-bcca-2e466ed4ba9f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:17.167937 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-9d942835-6f93-451e-bcca-2e466ed4ba9f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:17.171838 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9d942835-6f93-451e-bcca-2e466ed4ba9f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:17.172291 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9d942835-6f93-451e-bcca-2e466ed4ba9f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:17.173112 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9d942835-6f93-451e-bcca-2e466ed4ba9f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:17.173542 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9d942835-6f93-451e-bcca-2e466ed4ba9f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:17.185354 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f3a5e2f5-21a1-4ff4-b9d0-4fab855089a5 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:17.193842 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f3a5e2f5-21a1-4ff4-b9d0-4fab855089a5 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1569 microversion: 2.1 time: 0.543228 Jun 25 16:11:17.194826 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 292/579] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:16 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1569 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:17.206962 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9d942835-6f93-451e-bcca-2e466ed4ba9f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:17.207435 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9d942835-6f93-451e-bcca-2e466ed4ba9f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:17.207872 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.objects.instance [None req-9d942835-6f93-451e-bcca-2e466ed4ba9f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lazy-loading 'fault' on Instance uuid 8de27285-8f18-4d98-b240-0042e68f7ff9 {{(pid=117794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 16:11:17.264855 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-9d942835-6f93-451e-bcca-2e466ed4ba9f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:17.273396 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-9d942835-6f93-451e-bcca-2e466ed4ba9f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 200 len: 1334 microversion: 2.1 time: 0.111710 Jun 25 16:11:17.273983 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 288/580] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:17 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 1334 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:17.469867 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-609beeec-029e-4b0d-88ee-df131a54448a req-75c72a23-3c89-468b-bb42-8d456b3e7355 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2db6cecf-c268-4ee6-a745-6e2130e594bb", "tag": "172ac5a0-4d98-42ad-b245-4ffe24d39dde"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:11:17.473707 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:11:17.480902 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-609beeec-029e-4b0d-88ee-df131a54448a req-75c72a23-3c89-468b-bb42-8d456b3e7355 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:17.481428 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-609beeec-029e-4b0d-88ee-df131a54448a req-75c72a23-3c89-468b-bb42-8d456b3e7355 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:17.493799 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-609beeec-029e-4b0d-88ee-df131a54448a req-75c72a23-3c89-468b-bb42-8d456b3e7355 service nova] Creating event network-changed:172ac5a0-4d98-42ad-b245-4ffe24d39dde for instance 2db6cecf-c268-4ee6-a745-6e2130e594bb on hv-cinder-84762 Jun 25 16:11:17.498873 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-609beeec-029e-4b0d-88ee-df131a54448a req-75c72a23-3c89-468b-bb42-8d456b3e7355 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032998 Jun 25 16:11:17.499472 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 293/581] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 16:11:18.178642 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-21bcf81d-a58e-4587-af21-b5af2d1150f6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:18.179272 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-21bcf81d-a58e-4587-af21-b5af2d1150f6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:18.181710 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:11:18.186836 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-21bcf81d-a58e-4587-af21-b5af2d1150f6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:18.187550 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-21bcf81d-a58e-4587-af21-b5af2d1150f6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:18.188550 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-21bcf81d-a58e-4587-af21-b5af2d1150f6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:18.189280 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-21bcf81d-a58e-4587-af21-b5af2d1150f6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:18.212136 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9dfc388e-cb93-4709-8ddf-23f91ded3a93 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:18.212960 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9dfc388e-cb93-4709-8ddf-23f91ded3a93 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:18.225475 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9dfc388e-cb93-4709-8ddf-23f91ded3a93 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:18.228913 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9dfc388e-cb93-4709-8ddf-23f91ded3a93 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:18.229887 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9dfc388e-cb93-4709-8ddf-23f91ded3a93 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:18.230496 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9dfc388e-cb93-4709-8ddf-23f91ded3a93 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:18.512190 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-21bcf81d-a58e-4587-af21-b5af2d1150f6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:18.522527 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-21bcf81d-a58e-4587-af21-b5af2d1150f6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:18.524029 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-21bcf81d-a58e-4587-af21-b5af2d1150f6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:18.525385 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-21bcf81d-a58e-4587-af21-b5af2d1150f6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 200 len: 1723 microversion: 2.20 time: 0.350633 Jun 25 16:11:18.526237 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 289/582] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:11:18 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 1723 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:11:18.531235 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-8dfaff3a-a40b-42f2-98a1-8e603d70693b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:18.532209 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-8dfaff3a-a40b-42f2-98a1-8e603d70693b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 8de27285-8f18-4d98-b240-0042e68f7ff9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:18.538355 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8dfaff3a-a40b-42f2-98a1-8e603d70693b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:18.539056 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8dfaff3a-a40b-42f2-98a1-8e603d70693b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:18.540221 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8dfaff3a-a40b-42f2-98a1-8e603d70693b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:18.540884 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8dfaff3a-a40b-42f2-98a1-8e603d70693b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:18.542473 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9dfc388e-cb93-4709-8ddf-23f91ded3a93 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:18.555322 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.wsgi [None req-8dfaff3a-a40b-42f2-98a1-8e603d70693b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] HTTP exception thrown: Instance 8de27285-8f18-4d98-b240-0042e68f7ff9 could not be found. Jun 25 16:11:18.557301 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-8dfaff3a-a40b-42f2-98a1-8e603d70693b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Request method failure captured: Jun 25 16:11:18.557301 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: request: GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 HTTP/1.1 Jun 25 16:11:18.557301 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept: application/json Jun 25 16:11:18.557301 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept-Encoding: identity Jun 25 16:11:18.557301 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Connection: close Jun 25 16:11:18.557301 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Length: 0 Jun 25 16:11:18.557301 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Type: application/json Jun 25 16:11:18.557301 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Host: 10.222.0.13 Jun 25 16:11:18.557301 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Openstack-System-Scope: None Jun 25 16:11:18.557301 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: User-Agent: python-urllib3/1.26.9 Jun 25 16:11:18.557301 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Auth-Token: gAAAAABitzJy2PMEIGjU0D22ICPLrII0pgH6H7ewD2vw5w9vg92aD4-QfJukh_sXEAnvvJYv-lOHCKFN3Jsua1OnxR1mP-RhqYo9qs23StrKXzzDyf_m8VzQ_Av2b07vGTVgZTS2cklgCU5QDM54FSOcZVCDlTXhs3O31jqJozgvouxgWWInUng Jun 25 16:11:18.557301 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Id: None Jun 25 16:11:18.557301 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Name: None Jun 25 16:11:18.557301 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Identity-Status: Confirmed Jun 25 16:11:18.557301 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Is-Admin-Project: True Jun 25 16:11:18.557301 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Id: default Jun 25 16:11:18.557301 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Name: Default Jun 25 16:11:18.557301 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Id: 9bcee16336834b80a389799f89b5b79a Jun 25 16:11:18.557301 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1688542009 Jun 25 16:11:18.557301 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Role: reader,member Jun 25 16:11:18.557301 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Roles: reader,member Jun 25 16:11:18.558582 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9bcee16336834b80a389799f89b5b79a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9bcee16336834b80a389799f89b5b79a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9bcee16336834b80a389799f89b5b79a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9bcee16336834b80a389799f89b5b79a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:11:18.558582 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1688542009 Jun 25 16:11:18.558582 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Id: 9bcee16336834b80a389799f89b5b79a Jun 25 16:11:18.558582 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1688542009 Jun 25 16:11:18.558582 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User: tempest-ServerRescueNegativeTestJSON-1688542009-project Jun 25 16:11:18.558582 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Id: default Jun 25 16:11:18.558582 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Name: Default Jun 25 16:11:18.558582 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Id: 8a3137566b004edb909d4e3c702a7f59 Jun 25 16:11:18.558582 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1688542009-project Jun 25 16:11:18.558582 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: method: > Jun 25 16:11:18.558582 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: exception: Instance 8de27285-8f18-4d98-b240-0042e68f7ff9 could not be found. Jun 25 16:11:18.558582 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: action_args: {'id': '8de27285-8f18-4d98-b240-0042e68f7ff9'} Jun 25 16:11:18.559295 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:11:18.559295 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:11:18.559295 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:11:18.559295 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:11:18.559295 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:11:18.559295 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:11:18.559295 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:11:18.559295 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:11:18.559295 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:11:18.559295 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:11:18.559295 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8de27285-8f18-4d98-b240-0042e68f7ff9 could not be found. Jun 25 16:11:18.559295 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:11:18.559295 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:11:18.559295 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:11:18.559295 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:11:18.559295 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:11:18.559295 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:11:18.559295 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:11:18.559295 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:11:18.559295 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:11:18.560402 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:11:18.560402 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 16:11:18.560402 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 16:11:18.560402 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:11:18.560402 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:11:18.560402 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:11:18.560402 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:11:18.560402 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8de27285-8f18-4d98-b240-0042e68f7ff9 could not be found. Jun 25 16:11:18.560402 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:11:18.560402 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:11:18.560402 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:11:18.560402 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:11:18.560402 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:11:18.560402 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:11:18.560402 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:11:18.560402 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:11:18.560402 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8de27285-8f18-4d98-b240-0042e68f7ff9 could not be found. Jun 25 16:11:18.560402 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:11:18.561437 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9dfc388e-cb93-4709-8ddf-23f91ded3a93 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1569 microversion: 2.1 time: 0.349887 Jun 25 16:11:18.561437 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 294/583] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:18 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1569 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:11:18.563071 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-8dfaff3a-a40b-42f2-98a1-8e603d70693b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Returning 404 to user: Instance 8de27285-8f18-4d98-b240-0042e68f7ff9 could not be found. {{(pid=117794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:11:18.564162 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-8dfaff3a-a40b-42f2-98a1-8e603d70693b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9" status: 404 len: 111 microversion: 2.1 time: 0.036781 Jun 25 16:11:18.565177 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 290/584] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:18 2022] GET /compute/v2.1/servers/8de27285-8f18-4d98-b240-0042e68f7ff9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:11:18.573115 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-fdb88f10-abe9-44f2-baff-f47b7cb59ddc tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '.version_select at 0x7f65bb610280>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:18.592172 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-fdb88f10-abe9-44f2-baff-f47b7cb59ddc tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-474296034" status: 202 len: 0 microversion: 2.1 time: 0.022845 Jun 25 16:11:18.592789 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 295/585] 10.222.0.13 () {58 vars in 1217 bytes} [Sat Jun 25 16:11:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-474296034 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 16:11:19.514993 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-ab6a2fb5-1045-466d-91af-a8604db5c998 req-f693bd5e-8727-449d-953f-d7683d8af2a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6ae5a58-db83-401e-a158-ebf0981e84ec", "name": "network-vif-deleted", "tag": "3115b4bc-8a8e-494e-90f7-66772013aaf5"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:11:19.531465 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-ab6a2fb5-1045-466d-91af-a8604db5c998 req-f693bd5e-8727-449d-953f-d7683d8af2a1 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:19.532380 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-ab6a2fb5-1045-466d-91af-a8604db5c998 req-f693bd5e-8727-449d-953f-d7683d8af2a1 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:19.549131 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-eb30fce5-2821-461a-9d39-2248a847830c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:19.550321 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-ab6a2fb5-1045-466d-91af-a8604db5c998 req-f693bd5e-8727-449d-953f-d7683d8af2a1 service nova] Creating event network-vif-deleted:3115b4bc-8a8e-494e-90f7-66772013aaf5 for instance e6ae5a58-db83-401e-a158-ebf0981e84ec on hv-cinder-84762 Jun 25 16:11:19.550513 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-eb30fce5-2821-461a-9d39-2248a847830c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:19.555521 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-ab6a2fb5-1045-466d-91af-a8604db5c998 req-f693bd5e-8727-449d-953f-d7683d8af2a1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045997 Jun 25 16:11:19.557017 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 291/586] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:11:19.562530 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-eb30fce5-2821-461a-9d39-2248a847830c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:19.563287 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-eb30fce5-2821-461a-9d39-2248a847830c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:19.564206 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-eb30fce5-2821-461a-9d39-2248a847830c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:19.564769 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-eb30fce5-2821-461a-9d39-2248a847830c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:19.575735 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-12361fc4-e03f-49a1-8d9c-b698111e3fe8 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:19.576503 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-12361fc4-e03f-49a1-8d9c-b698111e3fe8 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:19.579525 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-eb30fce5-2821-461a-9d39-2248a847830c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] HTTP exception thrown: Instance e6ae5a58-db83-401e-a158-ebf0981e84ec could not be found. Jun 25 16:11:19.581568 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-eb30fce5-2821-461a-9d39-2248a847830c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Request method failure captured: Jun 25 16:11:19.581568 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec HTTP/1.1 Jun 25 16:11:19.581568 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept: application/json Jun 25 16:11:19.581568 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jun 25 16:11:19.581568 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Connection: close Jun 25 16:11:19.581568 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jun 25 16:11:19.581568 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jun 25 16:11:19.581568 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Host: 10.222.0.13 Jun 25 16:11:19.581568 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jun 25 16:11:19.581568 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jun 25 16:11:19.581568 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABitzLPXaDcj4dKOPfgjjri_C1-SyRZTd_fhOKnzEyt4fLtf90pxk0LWGKMcZbbirj9taIcsoY2m9qLNoVV7QiH1vcCDpXJrf5HBr6Fjx1ws7rNRA3jbH6Qu15vUt34XH0i7OdnrurR7MupWyI759xgN8WUUKJ4adEv-bx7R7lzXeuZ-lk Jun 25 16:11:19.581568 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jun 25 16:11:19.581568 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jun 25 16:11:19.581568 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jun 25 16:11:19.581568 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jun 25 16:11:19.581568 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Openstack-Nova-Api-Version: 2.20 Jun 25 16:11:19.581568 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jun 25 16:11:19.581568 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jun 25 16:11:19.581568 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Id: 0da9a82039c24056beec4b61f533eaa2 Jun 25 16:11:19.581568 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1604464304 Jun 25 16:11:19.581568 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Role: reader,member Jun 25 16:11:19.581568 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Jun 25 16:11:19.583027 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0da9a82039c24056beec4b61f533eaa2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0da9a82039c24056beec4b61f533eaa2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0da9a82039c24056beec4b61f533eaa2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0da9a82039c24056beec4b61f533eaa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:11:19.583027 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1604464304 Jun 25 16:11:19.583027 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 0da9a82039c24056beec4b61f533eaa2 Jun 25 16:11:19.583027 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1604464304 Jun 25 16:11:19.583027 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeShelveTestJSON-1604464304-project Jun 25 16:11:19.583027 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jun 25 16:11:19.583027 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jun 25 16:11:19.583027 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Id: 744eb9d4e7084b7e9cae36d5de67f0f0 Jun 25 16:11:19.583027 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1604464304-project Jun 25 16:11:19.583027 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: method: > Jun 25 16:11:19.583027 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: exception: Instance e6ae5a58-db83-401e-a158-ebf0981e84ec could not be found. Jun 25 16:11:19.583027 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: action_args: {'id': 'e6ae5a58-db83-401e-a158-ebf0981e84ec'} Jun 25 16:11:19.583778 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:11:19.583778 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:11:19.583778 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:11:19.583778 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:11:19.583778 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:11:19.583778 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:11:19.583778 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:11:19.583778 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:11:19.583778 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:11:19.583778 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:11:19.583778 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6ae5a58-db83-401e-a158-ebf0981e84ec could not be found. Jun 25 16:11:19.583778 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:11:19.583778 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:11:19.583778 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:11:19.583778 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:11:19.583778 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:11:19.583778 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:11:19.583778 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:11:19.583778 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:11:19.583778 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:11:19.584978 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:11:19.584978 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 16:11:19.584978 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 16:11:19.584978 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:11:19.584978 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:11:19.584978 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:11:19.584978 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:11:19.584978 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6ae5a58-db83-401e-a158-ebf0981e84ec could not be found. Jun 25 16:11:19.584978 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:11:19.584978 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:11:19.584978 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:11:19.584978 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:11:19.584978 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:11:19.584978 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:11:19.584978 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:11:19.584978 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:11:19.584978 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6ae5a58-db83-401e-a158-ebf0981e84ec could not be found. Jun 25 16:11:19.584978 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:11:19.586203 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-eb30fce5-2821-461a-9d39-2248a847830c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Returning 404 to user: Instance e6ae5a58-db83-401e-a158-ebf0981e84ec could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:11:19.586203 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-eb30fce5-2821-461a-9d39-2248a847830c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 404 len: 111 microversion: 2.20 time: 0.043346 Jun 25 16:11:19.586203 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 296/587] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:11:19 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 25 16:11:19.589951 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-12361fc4-e03f-49a1-8d9c-b698111e3fe8 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:19.590399 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-12361fc4-e03f-49a1-8d9c-b698111e3fe8 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:19.591203 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-12361fc4-e03f-49a1-8d9c-b698111e3fe8 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:19.591634 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-12361fc4-e03f-49a1-8d9c-b698111e3fe8 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:19.593337 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-dc421263-e00e-4de3-a0fa-e990b8dbf774 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '.version_select at 0x7f65bb64e790>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:19.613231 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-dc421263-e00e-4de3-a0fa-e990b8dbf774 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1531379064" status: 204 len: 0 microversion: 2.20 time: 0.024250 Jun 25 16:11:19.614357 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 297/588] 10.222.0.13 () {60 vars in 1261 bytes} [Sat Jun 25 16:11:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1531379064 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 25 16:11:19.746777 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-12361fc4-e03f-49a1-8d9c-b698111e3fe8 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:19.756187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-12361fc4-e03f-49a1-8d9c-b698111e3fe8 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1569 microversion: 2.1 time: 0.184572 Jun 25 16:11:19.756953 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 292/589] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:19 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1569 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:11:20.295691 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c832408d-24ff-4475-8f13-90ea5c33b105 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Action: 'create', calling method: .version_select at 0x7f65bb610280>, body: {"keypair": {"name": "tempest-keypair-991161026", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCaByQPsZ0tW/yoeGIAyS2f75BSluo+4ufs5Ygz2ePEr0241JanVrSd0NM95CIVGEB5JMoTvawyHX5uO9Nn61yUAuXET/PxGuN6so86pdSP6lWHCPFX1FsVZgpf4rMNutA=="}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:11:20.311115 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-c832408d-24ff-4475-8f13-90ea5c33b105 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Getting quotas for project 0da9a82039c24056beec4b61f533eaa2. Resources: {'key_pairs'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:11:20.315494 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-c832408d-24ff-4475-8f13-90ea5c33b105 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Getting quotas for user 744eb9d4e7084b7e9cae36d5de67f0f0 and project 0da9a82039c24056beec4b61f533eaa2. Resources: {'key_pairs'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:11:20.339924 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c832408d-24ff-4475-8f13-90ea5c33b105 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.050739 Jun 25 16:11:20.340513 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 298/590] 10.222.0.13 () {62 vars in 1199 bytes} [Sat Jun 25 16:11:20 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 25 16:11:20.774535 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-0fafecab-f8e4-4b55-8643-199d1e260521 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:20.775180 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-0fafecab-f8e4-4b55-8643-199d1e260521 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:20.783144 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0fafecab-f8e4-4b55-8643-199d1e260521 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:20.783804 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0fafecab-f8e4-4b55-8643-199d1e260521 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:20.784919 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0fafecab-f8e4-4b55-8643-199d1e260521 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:20.785565 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0fafecab-f8e4-4b55-8643-199d1e260521 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:21.006523 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-0fafecab-f8e4-4b55-8643-199d1e260521 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:21.010157 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:11:21.014993 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-0fafecab-f8e4-4b55-8643-199d1e260521 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1569 microversion: 2.1 time: 0.244089 Jun 25 16:11:21.024680 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 293/591] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:20 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1569 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:21.509173 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2157b915-2a1f-4747-905f-6c1c40fb7d79 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:21.509708 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2157b915-2a1f-4747-905f-6c1c40fb7d79 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:21.516438 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2157b915-2a1f-4747-905f-6c1c40fb7d79 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:21.516895 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2157b915-2a1f-4747-905f-6c1c40fb7d79 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:21.517679 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2157b915-2a1f-4747-905f-6c1c40fb7d79 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:21.518101 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2157b915-2a1f-4747-905f-6c1c40fb7d79 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:21.543469 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2157b915-2a1f-4747-905f-6c1c40fb7d79 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 16:11:21.632047 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2157b915-2a1f-4747-905f-6c1c40fb7d79 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 204 len: 0 microversion: 2.1 time: 0.127217 Jun 25 16:11:21.633169 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 299/592] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Jun 25 16:11:21 2022] DELETE /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 16:11:21.642331 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-0a763d06-181f-4707-9c37-e71317bfafb5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:21.642857 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-0a763d06-181f-4707-9c37-e71317bfafb5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:21.649463 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0a763d06-181f-4707-9c37-e71317bfafb5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:21.649921 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0a763d06-181f-4707-9c37-e71317bfafb5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:21.650726 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0a763d06-181f-4707-9c37-e71317bfafb5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:21.651162 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0a763d06-181f-4707-9c37-e71317bfafb5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:21.760342 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1363d3eb-be7c-4a13-94e5-a7b8f62eb72e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1574199198", "imageRef": "84c164fa-276d-4693-b7a0-24fd3024b359", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6882a8e8-9f13-47a2-87c9-a1eafb973bf6"}], "security_groups": [{"name": "tempest-securitygroup--1248055293"}], "key_name": "tempest-keypair-991161026", "user_data": "}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:11:21.787059 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-0a763d06-181f-4707-9c37-e71317bfafb5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:21.794630 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-0a763d06-181f-4707-9c37-e71317bfafb5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1507 microversion: 2.1 time: 0.157743 Jun 25 16:11:21.795141 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 294/593] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:21 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:11:21.863561 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-1363d3eb-be7c-4a13-94e5-a7b8f62eb72e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] validate_networks() for [('6882a8e8-9f13-47a2-87c9-a1eafb973bf6', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 16:11:22.032674 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-90659d33-c943-48b5-aea4-a029848c32f6 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:22.033275 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-90659d33-c943-48b5-aea4-a029848c32f6 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:22.039899 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-90659d33-c943-48b5-aea4-a029848c32f6 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:22.040348 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-90659d33-c943-48b5-aea4-a029848c32f6 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:22.041134 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-90659d33-c943-48b5-aea4-a029848c32f6 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:22.041635 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-90659d33-c943-48b5-aea4-a029848c32f6 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:22.240131 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-90659d33-c943-48b5-aea4-a029848c32f6 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:22.247846 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-90659d33-c943-48b5-aea4-a029848c32f6 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1569 microversion: 2.1 time: 0.219219 Jun 25 16:11:22.248439 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 295/594] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:22 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1569 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:22.333801 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-1363d3eb-be7c-4a13-94e5-a7b8f62eb72e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 16:11:22.334471 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-1363d3eb-be7c-4a13-94e5-a7b8f62eb72e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 16:11:22.335204 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-1363d3eb-be7c-4a13-94e5-a7b8f62eb72e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 16:11:22.335849 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-1363d3eb-be7c-4a13-94e5-a7b8f62eb72e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 16:11:22.336561 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-1363d3eb-be7c-4a13-94e5-a7b8f62eb72e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 16:11:22.349075 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1363d3eb-be7c-4a13-94e5-a7b8f62eb72e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:22.349513 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1363d3eb-be7c-4a13-94e5-a7b8f62eb72e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:22.350291 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1363d3eb-be7c-4a13-94e5-a7b8f62eb72e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:22.350723 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1363d3eb-be7c-4a13-94e5-a7b8f62eb72e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:22.368055 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-1363d3eb-be7c-4a13-94e5-a7b8f62eb72e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Getting quotas for project 0da9a82039c24056beec4b61f533eaa2. Resources: {'ram', 'cores', 'instances'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:11:22.372155 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-1363d3eb-be7c-4a13-94e5-a7b8f62eb72e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Getting quotas for user 744eb9d4e7084b7e9cae36d5de67f0f0 and project 0da9a82039c24056beec4b61f533eaa2. Resources: {'ram', 'cores', 'instances'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:11:22.384333 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1363d3eb-be7c-4a13-94e5-a7b8f62eb72e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 16:11:22.386768 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1363d3eb-be7c-4a13-94e5-a7b8f62eb72e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84c164fa-276d-4693-b7a0-24fd3024b359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 16:11:22.436940 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1363d3eb-be7c-4a13-94e5-a7b8f62eb72e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.681436 Jun 25 16:11:22.437626 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 300/595] 10.222.0.13 () {62 vars in 1187 bytes} [Sat Jun 25 16:11:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 25 16:11:22.447987 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-b7fb5c6d-93f0-44e9-87d3-86fa8da34438 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:22.448670 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-b7fb5c6d-93f0-44e9-87d3-86fa8da34438 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:22.507185 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-b7fb5c6d-93f0-44e9-87d3-86fa8da34438 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:22.514967 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-b7fb5c6d-93f0-44e9-87d3-86fa8da34438 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:22.517328 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-b7fb5c6d-93f0-44e9-87d3-86fa8da34438 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:22.518479 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-b7fb5c6d-93f0-44e9-87d3-86fa8da34438 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1281 microversion: 2.20 time: 0.074420 Jun 25 16:11:22.519282 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 296/596] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:11:22 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:11:22.812328 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e86c5657-6ecb-4ad5-af6b-323535dc4c1f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:22.813733 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e86c5657-6ecb-4ad5-af6b-323535dc4c1f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:22.821093 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e86c5657-6ecb-4ad5-af6b-323535dc4c1f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:22.821537 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e86c5657-6ecb-4ad5-af6b-323535dc4c1f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:22.822466 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e86c5657-6ecb-4ad5-af6b-323535dc4c1f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:22.822984 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e86c5657-6ecb-4ad5-af6b-323535dc4c1f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:22.951110 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e86c5657-6ecb-4ad5-af6b-323535dc4c1f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:22.958776 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e86c5657-6ecb-4ad5-af6b-323535dc4c1f tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1507 microversion: 2.1 time: 0.151013 Jun 25 16:11:22.959337 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 301/597] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:22 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:23.270031 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-26788ec4-fb09-4c71-b009-4ee6f2840c22 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:23.271065 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-26788ec4-fb09-4c71-b009-4ee6f2840c22 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:23.283503 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-26788ec4-fb09-4c71-b009-4ee6f2840c22 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:23.284240 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-26788ec4-fb09-4c71-b009-4ee6f2840c22 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:23.285576 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-26788ec4-fb09-4c71-b009-4ee6f2840c22 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:23.286286 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-26788ec4-fb09-4c71-b009-4ee6f2840c22 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:23.421819 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-26788ec4-fb09-4c71-b009-4ee6f2840c22 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:23.431507 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-26788ec4-fb09-4c71-b009-4ee6f2840c22 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1569 microversion: 2.1 time: 0.167629 Jun 25 16:11:23.432112 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 297/598] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:23 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:23.536775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-bd65696d-6dd8-4089-aea5-5c392e0d6f33 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:23.537381 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-bd65696d-6dd8-4089-aea5-5c392e0d6f33 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:23.543616 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd65696d-6dd8-4089-aea5-5c392e0d6f33 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:23.544063 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd65696d-6dd8-4089-aea5-5c392e0d6f33 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:23.544854 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd65696d-6dd8-4089-aea5-5c392e0d6f33 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:23.545288 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd65696d-6dd8-4089-aea5-5c392e0d6f33 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:23.611476 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-bd65696d-6dd8-4089-aea5-5c392e0d6f33 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:23.620319 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-bd65696d-6dd8-4089-aea5-5c392e0d6f33 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:23.621852 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-bd65696d-6dd8-4089-aea5-5c392e0d6f33 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:23.622965 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-bd65696d-6dd8-4089-aea5-5c392e0d6f33 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1277 microversion: 2.20 time: 0.090080 Jun 25 16:11:23.623859 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 302/599] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:11:23 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1277 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:11:23.975240 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-17f28943-a0ed-49f2-b933-28472d5b0236 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:23.976077 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-17f28943-a0ed-49f2-b933-28472d5b0236 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:23.982875 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-17f28943-a0ed-49f2-b933-28472d5b0236 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:23.983477 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-17f28943-a0ed-49f2-b933-28472d5b0236 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:23.984762 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-17f28943-a0ed-49f2-b933-28472d5b0236 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:23.985562 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-17f28943-a0ed-49f2-b933-28472d5b0236 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:24.450426 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ba483029-547c-445b-9fea-cdbc767286c6 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:24.451636 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ba483029-547c-445b-9fea-cdbc767286c6 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:24.458936 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ba483029-547c-445b-9fea-cdbc767286c6 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:24.459550 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ba483029-547c-445b-9fea-cdbc767286c6 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:24.460642 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ba483029-547c-445b-9fea-cdbc767286c6 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:24.461672 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ba483029-547c-445b-9fea-cdbc767286c6 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:24.541202 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-17f28943-a0ed-49f2-b933-28472d5b0236 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:24.551026 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-17f28943-a0ed-49f2-b933-28472d5b0236 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1507 microversion: 2.1 time: 0.579675 Jun 25 16:11:24.551834 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 298/600] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:23 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1507 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:24.650863 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-4e1307c3-e51e-4cde-8e3f-5e0bb488521a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:24.651890 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-4e1307c3-e51e-4cde-8e3f-5e0bb488521a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:24.662147 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4e1307c3-e51e-4cde-8e3f-5e0bb488521a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:24.663425 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4e1307c3-e51e-4cde-8e3f-5e0bb488521a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:24.664934 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4e1307c3-e51e-4cde-8e3f-5e0bb488521a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:24.665904 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4e1307c3-e51e-4cde-8e3f-5e0bb488521a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:24.778537 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-4e1307c3-e51e-4cde-8e3f-5e0bb488521a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:24.789509 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-4e1307c3-e51e-4cde-8e3f-5e0bb488521a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:24.789836 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ba483029-547c-445b-9fea-cdbc767286c6 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:24.792954 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-4e1307c3-e51e-4cde-8e3f-5e0bb488521a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:24.794018 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:11:24.795064 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-4e1307c3-e51e-4cde-8e3f-5e0bb488521a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1339 microversion: 2.20 time: 0.148786 Jun 25 16:11:24.806536 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 299/601] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:11:24 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1339 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:11:24.809039 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ba483029-547c-445b-9fea-cdbc767286c6 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1569 microversion: 2.1 time: 0.363410 Jun 25 16:11:24.809700 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 303/602] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:24 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1569 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:25.081836 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-5a179089-b4ab-430e-955a-af476ddb9740 req-04df16df-e6c5-4ac7-a24f-77ae8d0c6828 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5f6023f-52bc-4a18-af15-b1c7f2896f75", "name": "network-vif-deleted", "tag": "e355ac8e-fb57-4cd6-9b51-2346658384b8"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:11:25.096907 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-5a179089-b4ab-430e-955a-af476ddb9740 req-04df16df-e6c5-4ac7-a24f-77ae8d0c6828 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:25.097355 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-5a179089-b4ab-430e-955a-af476ddb9740 req-04df16df-e6c5-4ac7-a24f-77ae8d0c6828 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:25.115430 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-5a179089-b4ab-430e-955a-af476ddb9740 req-04df16df-e6c5-4ac7-a24f-77ae8d0c6828 service nova] Creating event network-vif-deleted:e355ac8e-fb57-4cd6-9b51-2346658384b8 for instance f5f6023f-52bc-4a18-af15-b1c7f2896f75 on hv-cinder-84762 Jun 25 16:11:25.120921 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-5a179089-b4ab-430e-955a-af476ddb9740 req-04df16df-e6c5-4ac7-a24f-77ae8d0c6828 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042968 Jun 25 16:11:25.122111 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 300/603] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:11:25.568581 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-eab6f6e6-8232-4824-89bf-c3308d008533 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:25.569296 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-eab6f6e6-8232-4824-89bf-c3308d008533 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:25.576334 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-eab6f6e6-8232-4824-89bf-c3308d008533 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:25.577031 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-eab6f6e6-8232-4824-89bf-c3308d008533 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:25.577989 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-eab6f6e6-8232-4824-89bf-c3308d008533 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:25.578505 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-eab6f6e6-8232-4824-89bf-c3308d008533 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:25.612510 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-eab6f6e6-8232-4824-89bf-c3308d008533 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:25.612933 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-eab6f6e6-8232-4824-89bf-c3308d008533 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:25.613396 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-eab6f6e6-8232-4824-89bf-c3308d008533 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lazy-loading 'fault' on Instance uuid f5f6023f-52bc-4a18-af15-b1c7f2896f75 {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 16:11:25.660480 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-eab6f6e6-8232-4824-89bf-c3308d008533 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:25.672448 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-6a9853d9-d4ad-405a-b264-456fd81ac8b4 req-cd25da7e-8a33-4111-94ae-7989f2f3b7c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "749fc9b1-a969-425d-b2e4-a88b63a45ffe", "tag": "faf6b184-57b1-4bce-bc06-d6f249c9b017"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:11:25.674032 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-eab6f6e6-8232-4824-89bf-c3308d008533 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 200 len: 1311 microversion: 2.1 time: 0.108582 Jun 25 16:11:25.674944 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 304/604] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:25 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 1311 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:25.683009 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-6a9853d9-d4ad-405a-b264-456fd81ac8b4 req-cd25da7e-8a33-4111-94ae-7989f2f3b7c6 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:25.683758 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-6a9853d9-d4ad-405a-b264-456fd81ac8b4 req-cd25da7e-8a33-4111-94ae-7989f2f3b7c6 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:25.702335 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-6a9853d9-d4ad-405a-b264-456fd81ac8b4 req-cd25da7e-8a33-4111-94ae-7989f2f3b7c6 service nova] Creating event network-changed:faf6b184-57b1-4bce-bc06-d6f249c9b017 for instance 749fc9b1-a969-425d-b2e4-a88b63a45ffe on hv-cinder-84762 Jun 25 16:11:25.707924 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-6a9853d9-d4ad-405a-b264-456fd81ac8b4 req-cd25da7e-8a33-4111-94ae-7989f2f3b7c6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040149 Jun 25 16:11:25.708660 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 301/605] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 16:11:25.813921 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e0d095ba-f8f3-4d65-964b-6cae146d6636 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:25.814519 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e0d095ba-f8f3-4d65-964b-6cae146d6636 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:25.820880 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0d095ba-f8f3-4d65-964b-6cae146d6636 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:25.821329 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0d095ba-f8f3-4d65-964b-6cae146d6636 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:25.822094 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0d095ba-f8f3-4d65-964b-6cae146d6636 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:25.822525 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e0d095ba-f8f3-4d65-964b-6cae146d6636 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:25.826950 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-2675a799-266c-40d0-a992-fd91e2ad973e tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:25.827689 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-2675a799-266c-40d0-a992-fd91e2ad973e tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:25.834632 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2675a799-266c-40d0-a992-fd91e2ad973e tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:25.835138 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2675a799-266c-40d0-a992-fd91e2ad973e tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:25.835936 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2675a799-266c-40d0-a992-fd91e2ad973e tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:25.836560 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2675a799-266c-40d0-a992-fd91e2ad973e tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:26.010657 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e0d095ba-f8f3-4d65-964b-6cae146d6636 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:26.019630 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e0d095ba-f8f3-4d65-964b-6cae146d6636 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:26.021191 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e0d095ba-f8f3-4d65-964b-6cae146d6636 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:26.022322 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e0d095ba-f8f3-4d65-964b-6cae146d6636 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1407 microversion: 2.20 time: 0.212761 Jun 25 16:11:26.022910 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 305/606] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:11:25 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1407 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:11:26.035093 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-2675a799-266c-40d0-a992-fd91e2ad973e tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:26.043450 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-2675a799-266c-40d0-a992-fd91e2ad973e tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1569 microversion: 2.1 time: 0.220652 Jun 25 16:11:26.043979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 302/607] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:25 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:26.691489 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ffab780f-875a-49ad-9cce-9b4d2cd19351 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:26.692910 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ffab780f-875a-49ad-9cce-9b4d2cd19351 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: f5f6023f-52bc-4a18-af15-b1c7f2896f75] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:26.702181 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ffab780f-875a-49ad-9cce-9b4d2cd19351 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:26.702631 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ffab780f-875a-49ad-9cce-9b4d2cd19351 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:26.703430 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ffab780f-875a-49ad-9cce-9b4d2cd19351 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:26.703863 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ffab780f-875a-49ad-9cce-9b4d2cd19351 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:26.718210 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-ffab780f-875a-49ad-9cce-9b4d2cd19351 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] HTTP exception thrown: Instance f5f6023f-52bc-4a18-af15-b1c7f2896f75 could not be found. Jun 25 16:11:26.719943 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ffab780f-875a-49ad-9cce-9b4d2cd19351 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Request method failure captured: Jun 25 16:11:26.719943 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 HTTP/1.1 Jun 25 16:11:26.719943 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept: application/json Jun 25 16:11:26.719943 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jun 25 16:11:26.719943 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Connection: close Jun 25 16:11:26.719943 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jun 25 16:11:26.719943 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jun 25 16:11:26.719943 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Host: 10.222.0.13 Jun 25 16:11:26.719943 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jun 25 16:11:26.719943 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jun 25 16:11:26.719943 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABitzJy2PMEIGjU0D22ICPLrII0pgH6H7ewD2vw5w9vg92aD4-QfJukh_sXEAnvvJYv-lOHCKFN3Jsua1OnxR1mP-RhqYo9qs23StrKXzzDyf_m8VzQ_Av2b07vGTVgZTS2cklgCU5QDM54FSOcZVCDlTXhs3O31jqJozgvouxgWWInUng Jun 25 16:11:26.719943 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jun 25 16:11:26.719943 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jun 25 16:11:26.719943 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jun 25 16:11:26.719943 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jun 25 16:11:26.719943 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jun 25 16:11:26.719943 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jun 25 16:11:26.719943 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Id: 9bcee16336834b80a389799f89b5b79a Jun 25 16:11:26.719943 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1688542009 Jun 25 16:11:26.719943 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Role: reader,member Jun 25 16:11:26.719943 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Jun 25 16:11:26.721468 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9bcee16336834b80a389799f89b5b79a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9bcee16336834b80a389799f89b5b79a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9bcee16336834b80a389799f89b5b79a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9bcee16336834b80a389799f89b5b79a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:11:26.721468 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1688542009 Jun 25 16:11:26.721468 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 9bcee16336834b80a389799f89b5b79a Jun 25 16:11:26.721468 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1688542009 Jun 25 16:11:26.721468 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User: tempest-ServerRescueNegativeTestJSON-1688542009-project Jun 25 16:11:26.721468 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jun 25 16:11:26.721468 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jun 25 16:11:26.721468 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Id: 8a3137566b004edb909d4e3c702a7f59 Jun 25 16:11:26.721468 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1688542009-project Jun 25 16:11:26.721468 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: method: > Jun 25 16:11:26.721468 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: exception: Instance f5f6023f-52bc-4a18-af15-b1c7f2896f75 could not be found. Jun 25 16:11:26.721468 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: action_args: {'id': 'f5f6023f-52bc-4a18-af15-b1c7f2896f75'} Jun 25 16:11:26.722207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:11:26.722207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:11:26.722207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:11:26.722207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:11:26.722207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:11:26.722207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:11:26.722207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:11:26.722207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:11:26.722207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:11:26.722207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:11:26.722207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5f6023f-52bc-4a18-af15-b1c7f2896f75 could not be found. Jun 25 16:11:26.722207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:11:26.722207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:11:26.722207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:11:26.722207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:11:26.722207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:11:26.722207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:11:26.722207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:11:26.722207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:11:26.722207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:11:26.723551 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:11:26.723551 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 16:11:26.723551 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 16:11:26.723551 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:11:26.723551 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:11:26.723551 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:11:26.723551 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:11:26.723551 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5f6023f-52bc-4a18-af15-b1c7f2896f75 could not be found. Jun 25 16:11:26.723551 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:11:26.723551 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:11:26.723551 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:11:26.723551 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:11:26.723551 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:11:26.723551 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:11:26.723551 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:11:26.723551 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:11:26.723551 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5f6023f-52bc-4a18-af15-b1c7f2896f75 could not be found. Jun 25 16:11:26.723551 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:11:26.724665 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ffab780f-875a-49ad-9cce-9b4d2cd19351 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Returning 404 to user: Instance f5f6023f-52bc-4a18-af15-b1c7f2896f75 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:11:26.724665 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ffab780f-875a-49ad-9cce-9b4d2cd19351 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75" status: 404 len: 111 microversion: 2.1 time: 0.034162 Jun 25 16:11:26.724665 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 306/608] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:26 2022] GET /compute/v2.1/servers/f5f6023f-52bc-4a18-af15-b1c7f2896f75 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 16:11:26.730110 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-511f5ee5-fae3-48a8-bd43-4a424fc399c5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:26.730623 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-511f5ee5-fae3-48a8-bd43-4a424fc399c5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 7feaccc2-e2e8-4644-87a9-4b88cd8767d5] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:26.737109 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-511f5ee5-fae3-48a8-bd43-4a424fc399c5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:26.737554 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-511f5ee5-fae3-48a8-bd43-4a424fc399c5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:26.738322 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-511f5ee5-fae3-48a8-bd43-4a424fc399c5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:26.738758 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-511f5ee5-fae3-48a8-bd43-4a424fc399c5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:26.763276 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-511f5ee5-fae3-48a8-bd43-4a424fc399c5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 7feaccc2-e2e8-4644-87a9-4b88cd8767d5] Going to try to terminate instance {{(pid=117794) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 16:11:26.844805 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-511f5ee5-fae3-48a8-bd43-4a424fc399c5 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "DELETE /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5" status: 204 len: 0 microversion: 2.1 time: 0.118272 Jun 25 16:11:26.845591 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 303/609] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Jun 25 16:11:26 2022] DELETE /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 16:11:26.853695 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e1af8ea8-ef7b-4f89-b901-15130de0e482 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:26.854328 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e1af8ea8-ef7b-4f89-b901-15130de0e482 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 7feaccc2-e2e8-4644-87a9-4b88cd8767d5] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:26.861098 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e1af8ea8-ef7b-4f89-b901-15130de0e482 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:26.861543 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e1af8ea8-ef7b-4f89-b901-15130de0e482 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:26.862311 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e1af8ea8-ef7b-4f89-b901-15130de0e482 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:26.863140 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e1af8ea8-ef7b-4f89-b901-15130de0e482 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:26.990741 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-e1af8ea8-ef7b-4f89-b901-15130de0e482 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:26.998259 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e1af8ea8-ef7b-4f89-b901-15130de0e482 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5" status: 200 len: 1521 microversion: 2.1 time: 0.148368 Jun 25 16:11:26.998810 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 307/610] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:26 2022] GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:27.040660 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-68146bb4-8cd3-4236-b868-2e63049337b3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:27.041366 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-68146bb4-8cd3-4236-b868-2e63049337b3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:27.048393 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-68146bb4-8cd3-4236-b868-2e63049337b3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:27.048920 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-68146bb4-8cd3-4236-b868-2e63049337b3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:27.049730 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-68146bb4-8cd3-4236-b868-2e63049337b3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:27.050174 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-68146bb4-8cd3-4236-b868-2e63049337b3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:27.060121 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a74db6bb-24d5-4810-a399-1c501ad6c908 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:27.060903 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a74db6bb-24d5-4810-a399-1c501ad6c908 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:27.069498 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a74db6bb-24d5-4810-a399-1c501ad6c908 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:27.069946 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a74db6bb-24d5-4810-a399-1c501ad6c908 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:27.070706 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a74db6bb-24d5-4810-a399-1c501ad6c908 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:27.071137 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a74db6bb-24d5-4810-a399-1c501ad6c908 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:27.254154 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-68146bb4-8cd3-4236-b868-2e63049337b3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:27.256650 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a74db6bb-24d5-4810-a399-1c501ad6c908 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:27.262831 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-68146bb4-8cd3-4236-b868-2e63049337b3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:27.264361 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-68146bb4-8cd3-4236-b868-2e63049337b3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:27.265354 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a74db6bb-24d5-4810-a399-1c501ad6c908 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1569 microversion: 2.1 time: 0.208949 Jun 25 16:11:27.265967 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 308/611] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:27 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1569 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:27.266503 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-68146bb4-8cd3-4236-b868-2e63049337b3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1407 microversion: 2.20 time: 0.229635 Jun 25 16:11:27.267062 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 304/612] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:11:27 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1407 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:11:27.708950 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-e224ad66-24f8-4569-9180-a357a6be792f req-3b79ac08-691f-4bc8-adbd-8701430666d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "affce264-2942-4aa8-850e-96642d84eff3", "name": "network-vif-unplugged", "status": "completed", "tag": "166dd48f-5e8c-48ce-8be5-c39460c7ef08"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:11:27.718185 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e224ad66-24f8-4569-9180-a357a6be792f req-3b79ac08-691f-4bc8-adbd-8701430666d9 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:27.718602 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e224ad66-24f8-4569-9180-a357a6be792f req-3b79ac08-691f-4bc8-adbd-8701430666d9 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:27.732311 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-e224ad66-24f8-4569-9180-a357a6be792f req-3b79ac08-691f-4bc8-adbd-8701430666d9 service nova] Creating event network-vif-unplugged:166dd48f-5e8c-48ce-8be5-c39460c7ef08 for instance affce264-2942-4aa8-850e-96642d84eff3 on hv-cinder-84762 Jun 25 16:11:27.737470 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-e224ad66-24f8-4569-9180-a357a6be792f req-3b79ac08-691f-4bc8-adbd-8701430666d9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032262 Jun 25 16:11:27.738092 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 309/613] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:11:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:11:28.018575 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-f2692b22-da02-4725-9be6-862918bf9b9b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:28.019156 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-f2692b22-da02-4725-9be6-862918bf9b9b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 7feaccc2-e2e8-4644-87a9-4b88cd8767d5] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:28.026174 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f2692b22-da02-4725-9be6-862918bf9b9b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:28.026617 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f2692b22-da02-4725-9be6-862918bf9b9b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:28.027374 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f2692b22-da02-4725-9be6-862918bf9b9b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:28.027802 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f2692b22-da02-4725-9be6-862918bf9b9b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:28.166078 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-f2692b22-da02-4725-9be6-862918bf9b9b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:28.174064 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-f2692b22-da02-4725-9be6-862918bf9b9b tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5" status: 200 len: 1521 microversion: 2.1 time: 0.160826 Jun 25 16:11:28.174634 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 305/614] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:28 2022] GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:28.286486 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-e73b3483-18be-4317-ab78-8548f95269d9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:28.286753 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f6fa1fb8-3c14-46cf-b82d-192365dc0b60 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:28.287233 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-e73b3483-18be-4317-ab78-8548f95269d9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:28.287644 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f6fa1fb8-3c14-46cf-b82d-192365dc0b60 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:28.294930 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e73b3483-18be-4317-ab78-8548f95269d9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:28.295489 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e73b3483-18be-4317-ab78-8548f95269d9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:28.295672 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f6fa1fb8-3c14-46cf-b82d-192365dc0b60 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:28.296130 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f6fa1fb8-3c14-46cf-b82d-192365dc0b60 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:28.296427 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e73b3483-18be-4317-ab78-8548f95269d9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:28.297095 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e73b3483-18be-4317-ab78-8548f95269d9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:28.297295 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f6fa1fb8-3c14-46cf-b82d-192365dc0b60 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:28.297863 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f6fa1fb8-3c14-46cf-b82d-192365dc0b60 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:28.504671 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-e73b3483-18be-4317-ab78-8548f95269d9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:28.509183 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f6fa1fb8-3c14-46cf-b82d-192365dc0b60 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:28.517094 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-e73b3483-18be-4317-ab78-8548f95269d9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:28.518661 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-e73b3483-18be-4317-ab78-8548f95269d9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:28.519472 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f6fa1fb8-3c14-46cf-b82d-192365dc0b60 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1569 microversion: 2.1 time: 0.238133 Jun 25 16:11:28.519774 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-e73b3483-18be-4317-ab78-8548f95269d9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1407 microversion: 2.20 time: 0.238035 Jun 25 16:11:28.520347 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 310/615] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:28 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1569 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:28.520527 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 306/616] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:11:28 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1407 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:11:29.194900 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3eb80db5-9250-4328-a1f3-6322ddd17a72 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:29.195952 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3eb80db5-9250-4328-a1f3-6322ddd17a72 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 7feaccc2-e2e8-4644-87a9-4b88cd8767d5] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:29.205824 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3eb80db5-9250-4328-a1f3-6322ddd17a72 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:29.206279 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3eb80db5-9250-4328-a1f3-6322ddd17a72 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:29.207041 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3eb80db5-9250-4328-a1f3-6322ddd17a72 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:29.207471 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3eb80db5-9250-4328-a1f3-6322ddd17a72 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:29.341521 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3eb80db5-9250-4328-a1f3-6322ddd17a72 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:29.349660 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3eb80db5-9250-4328-a1f3-6322ddd17a72 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5" status: 200 len: 1521 microversion: 2.1 time: 0.161214 Jun 25 16:11:29.350228 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 311/617] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:29 2022] GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:29.541110 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-ff6b19ea-73b0-4d74-8316-a8c3fe0a4a3f tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:29.541938 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-46840557-8570-4021-891f-998cb6020108 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:29.542112 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-46840557-8570-4021-891f-998cb6020108 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:29.542315 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-ff6b19ea-73b0-4d74-8316-a8c3fe0a4a3f tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:29.550417 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-46840557-8570-4021-891f-998cb6020108 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:29.550869 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-46840557-8570-4021-891f-998cb6020108 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:29.551456 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ff6b19ea-73b0-4d74-8316-a8c3fe0a4a3f tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:29.551795 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-46840557-8570-4021-891f-998cb6020108 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:29.551939 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ff6b19ea-73b0-4d74-8316-a8c3fe0a4a3f tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:29.552345 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-46840557-8570-4021-891f-998cb6020108 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:29.552702 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ff6b19ea-73b0-4d74-8316-a8c3fe0a4a3f tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:29.553149 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-ff6b19ea-73b0-4d74-8316-a8c3fe0a4a3f tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:29.763192 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-46840557-8570-4021-891f-998cb6020108 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:29.769025 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-ff6b19ea-73b0-4d74-8316-a8c3fe0a4a3f tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:29.773451 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-46840557-8570-4021-891f-998cb6020108 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:29.775080 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-46840557-8570-4021-891f-998cb6020108 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:29.776456 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-46840557-8570-4021-891f-998cb6020108 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1407 microversion: 2.20 time: 0.241529 Jun 25 16:11:29.777170 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 312/618] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:11:29 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1407 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:11:29.777302 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-ff6b19ea-73b0-4d74-8316-a8c3fe0a4a3f tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1569 microversion: 2.1 time: 0.242837 Jun 25 16:11:29.787427 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 307/619] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:29 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1569 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:30.367319 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4c0566e7-07b4-4f02-bafd-a67aad0375e9 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:30.368243 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4c0566e7-07b4-4f02-bafd-a67aad0375e9 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 7feaccc2-e2e8-4644-87a9-4b88cd8767d5] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:30.375916 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4c0566e7-07b4-4f02-bafd-a67aad0375e9 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:30.376502 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4c0566e7-07b4-4f02-bafd-a67aad0375e9 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:30.377397 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4c0566e7-07b4-4f02-bafd-a67aad0375e9 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:30.377915 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4c0566e7-07b4-4f02-bafd-a67aad0375e9 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:30.433204 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-f0b976a4-88d1-417f-bc60-ea705700be36 req-b6ea011f-950c-44eb-8db2-50f4a3be4535 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7feaccc2-e2e8-4644-87a9-4b88cd8767d5", "name": "network-vif-deleted", "tag": "dda3a175-359c-4380-a748-ac6e5ec45c69"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:11:30.447141 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-f0b976a4-88d1-417f-bc60-ea705700be36 req-b6ea011f-950c-44eb-8db2-50f4a3be4535 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:30.447855 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-f0b976a4-88d1-417f-bc60-ea705700be36 req-b6ea011f-950c-44eb-8db2-50f4a3be4535 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:30.463263 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-f0b976a4-88d1-417f-bc60-ea705700be36 req-b6ea011f-950c-44eb-8db2-50f4a3be4535 service nova] Creating event network-vif-deleted:dda3a175-359c-4380-a748-ac6e5ec45c69 for instance 7feaccc2-e2e8-4644-87a9-4b88cd8767d5 on hv-cinder-84762 Jun 25 16:11:30.470081 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4c0566e7-07b4-4f02-bafd-a67aad0375e9 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:30.472349 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-f0b976a4-88d1-417f-bc60-ea705700be36 req-b6ea011f-950c-44eb-8db2-50f4a3be4535 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043230 Jun 25 16:11:30.473715 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 308/620] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:11:30.482618 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4c0566e7-07b4-4f02-bafd-a67aad0375e9 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5" status: 200 len: 1479 microversion: 2.1 time: 0.119925 Jun 25 16:11:30.484372 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 313/621] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:30 2022] GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5 => generated 1479 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:30.796074 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-be8a8d82-6d05-4e85-9cd1-c8f17ae4aba2 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:30.796778 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7f51f1ca-8a88-4f10-b2a9-fabddeb1a579 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:30.796947 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-be8a8d82-6d05-4e85-9cd1-c8f17ae4aba2 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:30.797184 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7f51f1ca-8a88-4f10-b2a9-fabddeb1a579 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:30.804612 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-be8a8d82-6d05-4e85-9cd1-c8f17ae4aba2 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:30.805333 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-be8a8d82-6d05-4e85-9cd1-c8f17ae4aba2 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:30.805603 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7f51f1ca-8a88-4f10-b2a9-fabddeb1a579 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:30.806119 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7f51f1ca-8a88-4f10-b2a9-fabddeb1a579 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:30.806793 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-be8a8d82-6d05-4e85-9cd1-c8f17ae4aba2 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:30.807027 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7f51f1ca-8a88-4f10-b2a9-fabddeb1a579 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:30.807524 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7f51f1ca-8a88-4f10-b2a9-fabddeb1a579 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:30.807717 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-be8a8d82-6d05-4e85-9cd1-c8f17ae4aba2 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:31.005973 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-be8a8d82-6d05-4e85-9cd1-c8f17ae4aba2 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:31.021187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-be8a8d82-6d05-4e85-9cd1-c8f17ae4aba2 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:31.022669 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-be8a8d82-6d05-4e85-9cd1-c8f17ae4aba2 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:31.023782 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-be8a8d82-6d05-4e85-9cd1-c8f17ae4aba2 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1407 microversion: 2.20 time: 0.232712 Jun 25 16:11:31.024303 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 309/622] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:11:30 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1407 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:11:31.032729 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7f51f1ca-8a88-4f10-b2a9-fabddeb1a579 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:31.040912 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7f51f1ca-8a88-4f10-b2a9-fabddeb1a579 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1510 microversion: 2.1 time: 0.249501 Jun 25 16:11:31.041468 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 314/623] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:30 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1510 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:31.057426 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-95dcc03b-1c1f-483e-acd8-c0393a405665 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:11:31.057985 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-95dcc03b-1c1f-483e-acd8-c0393a405665 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:31.064084 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-95dcc03b-1c1f-483e-acd8-c0393a405665 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:31.064577 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-95dcc03b-1c1f-483e-acd8-c0393a405665 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:31.065337 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-95dcc03b-1c1f-483e-acd8-c0393a405665 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:31.065768 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-95dcc03b-1c1f-483e-acd8-c0393a405665 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:31.137177 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:11:31.153367 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-95dcc03b-1c1f-483e-acd8-c0393a405665 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "POST /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3/action" status: 202 len: 0 microversion: 2.1 time: 0.099800 Jun 25 16:11:31.153932 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 310/624] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Jun 25 16:11:31 2022] POST /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 16:11:31.162006 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-bf7d4b76-7501-4471-9d49-5a8cc927cb71 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:31.162603 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-bf7d4b76-7501-4471-9d49-5a8cc927cb71 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:31.168544 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bf7d4b76-7501-4471-9d49-5a8cc927cb71 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:31.168985 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bf7d4b76-7501-4471-9d49-5a8cc927cb71 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:31.169734 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bf7d4b76-7501-4471-9d49-5a8cc927cb71 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:31.170158 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bf7d4b76-7501-4471-9d49-5a8cc927cb71 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:31.304148 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-bf7d4b76-7501-4471-9d49-5a8cc927cb71 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:31.311940 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-bf7d4b76-7501-4471-9d49-5a8cc927cb71 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1518 microversion: 2.1 time: 0.153797 Jun 25 16:11:31.313213 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 315/625] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:31 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:31.501473 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-75aa0a86-e08d-4d08-8f66-45a508279c5e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:31.502254 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-75aa0a86-e08d-4d08-8f66-45a508279c5e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 7feaccc2-e2e8-4644-87a9-4b88cd8767d5] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:31.509596 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-75aa0a86-e08d-4d08-8f66-45a508279c5e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:31.510119 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-75aa0a86-e08d-4d08-8f66-45a508279c5e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:31.511033 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-75aa0a86-e08d-4d08-8f66-45a508279c5e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:31.511518 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-75aa0a86-e08d-4d08-8f66-45a508279c5e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:31.548096 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-75aa0a86-e08d-4d08-8f66-45a508279c5e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:31.548636 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-75aa0a86-e08d-4d08-8f66-45a508279c5e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:31.549374 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.objects.instance [None req-75aa0a86-e08d-4d08-8f66-45a508279c5e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lazy-loading 'fault' on Instance uuid 7feaccc2-e2e8-4644-87a9-4b88cd8767d5 {{(pid=117794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 16:11:31.594480 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-75aa0a86-e08d-4d08-8f66-45a508279c5e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a3137566b004edb909d4e3c702a7f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9bcee16336834b80a389799f89b5b79a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:31.608149 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-75aa0a86-e08d-4d08-8f66-45a508279c5e tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5" status: 200 len: 1311 microversion: 2.1 time: 0.110837 Jun 25 16:11:31.612444 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 311/626] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:31 2022] GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5 => generated 1311 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:32.042132 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9dbea71c-23a0-4308-8d91-801d6600d412 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:32.042860 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9dbea71c-23a0-4308-8d91-801d6600d412 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:32.049756 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9dbea71c-23a0-4308-8d91-801d6600d412 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:32.050208 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9dbea71c-23a0-4308-8d91-801d6600d412 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:32.051090 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9dbea71c-23a0-4308-8d91-801d6600d412 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:32.052101 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9dbea71c-23a0-4308-8d91-801d6600d412 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:32.195289 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9dbea71c-23a0-4308-8d91-801d6600d412 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:32.205641 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9dbea71c-23a0-4308-8d91-801d6600d412 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:32.207174 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9dbea71c-23a0-4308-8d91-801d6600d412 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:32.208292 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9dbea71c-23a0-4308-8d91-801d6600d412 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1407 microversion: 2.20 time: 0.170186 Jun 25 16:11:32.208863 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 316/627] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:11:32 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:11:32.329680 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-e937589b-7a9a-432a-b634-858843ae9732 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:32.330269 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-e937589b-7a9a-432a-b634-858843ae9732 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:32.336918 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e937589b-7a9a-432a-b634-858843ae9732 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:32.337379 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e937589b-7a9a-432a-b634-858843ae9732 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:32.338124 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e937589b-7a9a-432a-b634-858843ae9732 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:32.338565 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e937589b-7a9a-432a-b634-858843ae9732 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:32.474170 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-e937589b-7a9a-432a-b634-858843ae9732 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:32.482418 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-e937589b-7a9a-432a-b634-858843ae9732 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1520 microversion: 2.1 time: 0.156664 Jun 25 16:11:32.482992 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 312/628] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:32 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:32.627970 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-856467c1-956b-4d8a-b871-fdb65efd3398 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:32.628455 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-856467c1-956b-4d8a-b871-fdb65efd3398 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] [instance: 7feaccc2-e2e8-4644-87a9-4b88cd8767d5] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:32.630446 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:11:32.631113 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=10 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:11:32.637366 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-856467c1-956b-4d8a-b871-fdb65efd3398 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:32.637815 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-856467c1-956b-4d8a-b871-fdb65efd3398 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:32.638612 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-856467c1-956b-4d8a-b871-fdb65efd3398 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:32.639047 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-856467c1-956b-4d8a-b871-fdb65efd3398 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:32.653142 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-856467c1-956b-4d8a-b871-fdb65efd3398 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] HTTP exception thrown: Instance 7feaccc2-e2e8-4644-87a9-4b88cd8767d5 could not be found. Jun 25 16:11:32.654813 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-856467c1-956b-4d8a-b871-fdb65efd3398 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Request method failure captured: Jun 25 16:11:32.654813 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5 HTTP/1.1 Jun 25 16:11:32.654813 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept: application/json Jun 25 16:11:32.654813 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jun 25 16:11:32.654813 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Connection: close Jun 25 16:11:32.654813 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jun 25 16:11:32.654813 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jun 25 16:11:32.654813 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Host: 10.222.0.13 Jun 25 16:11:32.654813 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jun 25 16:11:32.654813 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jun 25 16:11:32.654813 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABitzJy2PMEIGjU0D22ICPLrII0pgH6H7ewD2vw5w9vg92aD4-QfJukh_sXEAnvvJYv-lOHCKFN3Jsua1OnxR1mP-RhqYo9qs23StrKXzzDyf_m8VzQ_Av2b07vGTVgZTS2cklgCU5QDM54FSOcZVCDlTXhs3O31jqJozgvouxgWWInUng Jun 25 16:11:32.654813 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jun 25 16:11:32.654813 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jun 25 16:11:32.654813 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jun 25 16:11:32.654813 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jun 25 16:11:32.654813 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jun 25 16:11:32.654813 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jun 25 16:11:32.654813 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Id: 9bcee16336834b80a389799f89b5b79a Jun 25 16:11:32.654813 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1688542009 Jun 25 16:11:32.654813 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Role: reader,member Jun 25 16:11:32.654813 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Jun 25 16:11:32.656548 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9bcee16336834b80a389799f89b5b79a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9bcee16336834b80a389799f89b5b79a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9bcee16336834b80a389799f89b5b79a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9bcee16336834b80a389799f89b5b79a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:11:32.656548 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1688542009 Jun 25 16:11:32.656548 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 9bcee16336834b80a389799f89b5b79a Jun 25 16:11:32.656548 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1688542009 Jun 25 16:11:32.656548 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User: tempest-ServerRescueNegativeTestJSON-1688542009-project Jun 25 16:11:32.656548 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jun 25 16:11:32.656548 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jun 25 16:11:32.656548 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Id: 8a3137566b004edb909d4e3c702a7f59 Jun 25 16:11:32.656548 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1688542009-project Jun 25 16:11:32.656548 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: method: > Jun 25 16:11:32.656548 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: exception: Instance 7feaccc2-e2e8-4644-87a9-4b88cd8767d5 could not be found. Jun 25 16:11:32.656548 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: action_args: {'id': '7feaccc2-e2e8-4644-87a9-4b88cd8767d5'} Jun 25 16:11:32.657356 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:11:32.657356 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:11:32.657356 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:11:32.657356 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:11:32.657356 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:11:32.657356 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:11:32.657356 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:11:32.657356 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:11:32.657356 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:11:32.657356 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:11:32.657356 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7feaccc2-e2e8-4644-87a9-4b88cd8767d5 could not be found. Jun 25 16:11:32.657356 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:11:32.657356 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:11:32.657356 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:11:32.657356 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:11:32.657356 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:11:32.657356 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:11:32.657356 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:11:32.657356 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:11:32.657356 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:11:32.658470 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:11:32.658470 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 16:11:32.658470 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 16:11:32.658470 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:11:32.658470 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:11:32.658470 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:11:32.658470 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:11:32.658470 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7feaccc2-e2e8-4644-87a9-4b88cd8767d5 could not be found. Jun 25 16:11:32.658470 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:11:32.658470 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:11:32.658470 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:11:32.658470 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:11:32.658470 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:11:32.658470 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:11:32.658470 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:11:32.658470 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:11:32.658470 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7feaccc2-e2e8-4644-87a9-4b88cd8767d5 could not be found. Jun 25 16:11:32.658470 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:11:32.659494 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-856467c1-956b-4d8a-b871-fdb65efd3398 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] Returning 404 to user: Instance 7feaccc2-e2e8-4644-87a9-4b88cd8767d5 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:11:32.659494 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-856467c1-956b-4d8a-b871-fdb65efd3398 tempest-ServerRescueNegativeTestJSON-1688542009 tempest-ServerRescueNegativeTestJSON-1688542009-project] 10.222.0.13 "GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5" status: 404 len: 111 microversion: 2.1 time: 0.033174 Jun 25 16:11:32.659494 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 317/629] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:32 2022] GET /compute/v2.1/servers/7feaccc2-e2e8-4644-87a9-4b88cd8767d5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:11:33.226481 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-72f7069a-7fde-4e24-8228-e22af3916951 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:33.227056 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-72f7069a-7fde-4e24-8228-e22af3916951 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:33.229207 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell0:SELECT=2 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:11:33.235266 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-72f7069a-7fde-4e24-8228-e22af3916951 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:33.236013 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-72f7069a-7fde-4e24-8228-e22af3916951 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:33.237119 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-72f7069a-7fde-4e24-8228-e22af3916951 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:33.237759 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-72f7069a-7fde-4e24-8228-e22af3916951 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:33.455366 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-72f7069a-7fde-4e24-8228-e22af3916951 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:33.463946 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-72f7069a-7fde-4e24-8228-e22af3916951 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:33.465477 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-72f7069a-7fde-4e24-8228-e22af3916951 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:33.466706 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-72f7069a-7fde-4e24-8228-e22af3916951 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1407 microversion: 2.20 time: 0.244161 Jun 25 16:11:33.467233 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 313/630] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:11:33 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:11:33.500931 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-370f5787-eac1-478e-9b99-409d03c6af86 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:33.501539 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-370f5787-eac1-478e-9b99-409d03c6af86 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:33.508296 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-370f5787-eac1-478e-9b99-409d03c6af86 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:33.508821 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-370f5787-eac1-478e-9b99-409d03c6af86 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:33.509581 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-370f5787-eac1-478e-9b99-409d03c6af86 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:33.510011 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-370f5787-eac1-478e-9b99-409d03c6af86 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:33.697666 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-370f5787-eac1-478e-9b99-409d03c6af86 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:33.706921 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-370f5787-eac1-478e-9b99-409d03c6af86 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1576 microversion: 2.1 time: 0.210159 Jun 25 16:11:33.707608 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 318/631] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:33 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1576 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:34.485390 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-858ff20e-e05a-4726-b279-40486c93f72d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:34.486017 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-858ff20e-e05a-4726-b279-40486c93f72d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:34.492813 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-858ff20e-e05a-4726-b279-40486c93f72d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:34.493259 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-858ff20e-e05a-4726-b279-40486c93f72d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:34.494037 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-858ff20e-e05a-4726-b279-40486c93f72d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:34.494502 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-858ff20e-e05a-4726-b279-40486c93f72d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:34.723365 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-858ff20e-e05a-4726-b279-40486c93f72d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:34.725791 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-437924ff-c9a9-43ff-90f9-d08adc42e923 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:34.726995 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-437924ff-c9a9-43ff-90f9-d08adc42e923 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:34.732802 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-858ff20e-e05a-4726-b279-40486c93f72d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:34.733689 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-437924ff-c9a9-43ff-90f9-d08adc42e923 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:34.734521 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-437924ff-c9a9-43ff-90f9-d08adc42e923 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:34.735336 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-858ff20e-e05a-4726-b279-40486c93f72d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:34.736268 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-437924ff-c9a9-43ff-90f9-d08adc42e923 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:34.736883 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-437924ff-c9a9-43ff-90f9-d08adc42e923 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:34.737145 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-858ff20e-e05a-4726-b279-40486c93f72d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1407 microversion: 2.20 time: 0.255564 Jun 25 16:11:34.748344 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 314/632] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:11:34 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:11:34.934085 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-437924ff-c9a9-43ff-90f9-d08adc42e923 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:34.942425 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-437924ff-c9a9-43ff-90f9-d08adc42e923 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1576 microversion: 2.1 time: 0.220966 Jun 25 16:11:34.952238 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 319/633] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:34 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1576 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:35.755459 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-9d698770-e3de-473c-a2ae-427e7988f0eb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:35.756074 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-9d698770-e3de-473c-a2ae-427e7988f0eb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:35.763220 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9d698770-e3de-473c-a2ae-427e7988f0eb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:35.763679 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9d698770-e3de-473c-a2ae-427e7988f0eb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:35.768620 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9d698770-e3de-473c-a2ae-427e7988f0eb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:35.769070 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9d698770-e3de-473c-a2ae-427e7988f0eb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:35.880477 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-78a4d9c5-7467-4567-b18f-d77677fc269a req-5a1a62ef-ac7a-4def-a78e-626f95c3ff95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "749fc9b1-a969-425d-b2e4-a88b63a45ffe", "name": "network-vif-plugged", "status": "completed", "tag": "faf6b184-57b1-4bce-bc06-d6f249c9b017"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:11:35.892777 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-78a4d9c5-7467-4567-b18f-d77677fc269a req-5a1a62ef-ac7a-4def-a78e-626f95c3ff95 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:35.893149 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-78a4d9c5-7467-4567-b18f-d77677fc269a req-5a1a62ef-ac7a-4def-a78e-626f95c3ff95 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:35.917298 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-78a4d9c5-7467-4567-b18f-d77677fc269a req-5a1a62ef-ac7a-4def-a78e-626f95c3ff95 service nova] Creating event network-vif-plugged:faf6b184-57b1-4bce-bc06-d6f249c9b017 for instance 749fc9b1-a969-425d-b2e4-a88b63a45ffe on hv-cinder-84762 Jun 25 16:11:35.923860 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-78a4d9c5-7467-4567-b18f-d77677fc269a req-5a1a62ef-ac7a-4def-a78e-626f95c3ff95 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046942 Jun 25 16:11:35.924879 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 320/634] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 16:11:35.959889 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9a67c071-608a-4b65-9142-af533d9d292a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:35.961321 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9a67c071-608a-4b65-9142-af533d9d292a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:35.976081 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9a67c071-608a-4b65-9142-af533d9d292a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:35.976584 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9a67c071-608a-4b65-9142-af533d9d292a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:35.979204 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9a67c071-608a-4b65-9142-af533d9d292a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:35.979665 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9a67c071-608a-4b65-9142-af533d9d292a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:36.040732 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-9d698770-e3de-473c-a2ae-427e7988f0eb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:36.062249 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-9d698770-e3de-473c-a2ae-427e7988f0eb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:36.064598 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-9d698770-e3de-473c-a2ae-427e7988f0eb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:36.066500 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-9d698770-e3de-473c-a2ae-427e7988f0eb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1407 microversion: 2.20 time: 0.314736 Jun 25 16:11:36.066989 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 315/635] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:11:35 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1407 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:11:36.233532 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9a67c071-608a-4b65-9142-af533d9d292a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:36.243041 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9a67c071-608a-4b65-9142-af533d9d292a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1576 microversion: 2.1 time: 0.287438 Jun 25 16:11:36.243735 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 321/636] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:35 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1576 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:37.084442 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-d7c2af55-de4c-4899-b385-06eac4025548 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:37.085072 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-d7c2af55-de4c-4899-b385-06eac4025548 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:37.091842 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d7c2af55-de4c-4899-b385-06eac4025548 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:37.092300 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d7c2af55-de4c-4899-b385-06eac4025548 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:37.093110 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d7c2af55-de4c-4899-b385-06eac4025548 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:37.093629 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d7c2af55-de4c-4899-b385-06eac4025548 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:37.232667 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d7c2af55-de4c-4899-b385-06eac4025548 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:37.241195 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d7c2af55-de4c-4899-b385-06eac4025548 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:37.242704 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d7c2af55-de4c-4899-b385-06eac4025548 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:37.243806 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-d7c2af55-de4c-4899-b385-06eac4025548 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1407 microversion: 2.20 time: 0.163354 Jun 25 16:11:37.244344 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 316/637] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:11:37 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:11:37.260534 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2ab65a1a-d740-47f5-b2d3-ad8a0693d17a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:37.261143 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2ab65a1a-d740-47f5-b2d3-ad8a0693d17a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:37.268939 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2ab65a1a-d740-47f5-b2d3-ad8a0693d17a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:37.269393 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2ab65a1a-d740-47f5-b2d3-ad8a0693d17a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:37.270166 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2ab65a1a-d740-47f5-b2d3-ad8a0693d17a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:37.270585 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2ab65a1a-d740-47f5-b2d3-ad8a0693d17a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:37.409958 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2ab65a1a-d740-47f5-b2d3-ad8a0693d17a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:37.413476 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=100 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:11:37.418581 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2ab65a1a-d740-47f5-b2d3-ad8a0693d17a tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1576 microversion: 2.1 time: 0.162166 Jun 25 16:11:37.419167 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 322/638] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:37 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:38.262138 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-4877be54-e206-4939-98a5-1524202c1d1a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:38.263342 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-4877be54-e206-4939-98a5-1524202c1d1a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:38.271458 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4877be54-e206-4939-98a5-1524202c1d1a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:38.271899 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4877be54-e206-4939-98a5-1524202c1d1a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:38.272721 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4877be54-e206-4939-98a5-1524202c1d1a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:38.273205 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4877be54-e206-4939-98a5-1524202c1d1a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:38.409675 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-4877be54-e206-4939-98a5-1524202c1d1a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:38.418824 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-4877be54-e206-4939-98a5-1524202c1d1a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:38.420512 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-4877be54-e206-4939-98a5-1524202c1d1a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:38.421857 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-4877be54-e206-4939-98a5-1524202c1d1a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1599 microversion: 2.20 time: 0.163687 Jun 25 16:11:38.422605 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 317/639] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:11:38 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:11:38.440333 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-6c529b64-84ce-424c-bb7b-5dddd1fa3ba9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:38.441181 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-6c529b64-84ce-424c-bb7b-5dddd1fa3ba9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:38.441301 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-88f9e235-9705-445f-9ecd-5213968923fc tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:38.441986 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-88f9e235-9705-445f-9ecd-5213968923fc tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:38.448783 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6c529b64-84ce-424c-bb7b-5dddd1fa3ba9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:38.449515 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6c529b64-84ce-424c-bb7b-5dddd1fa3ba9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:38.450503 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6c529b64-84ce-424c-bb7b-5dddd1fa3ba9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:38.451297 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-88f9e235-9705-445f-9ecd-5213968923fc tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:38.451467 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6c529b64-84ce-424c-bb7b-5dddd1fa3ba9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:38.451757 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-88f9e235-9705-445f-9ecd-5213968923fc tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:38.452675 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-88f9e235-9705-445f-9ecd-5213968923fc tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:38.453949 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-88f9e235-9705-445f-9ecd-5213968923fc tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:38.590533 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-6c529b64-84ce-424c-bb7b-5dddd1fa3ba9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.154979 Jun 25 16:11:38.591422 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 318/640] 10.222.0.13 () {60 vars in 1315 bytes} [Sat Jun 25 16:11:38 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe/os-interface => generated 285 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 25 16:11:39.051477 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-88f9e235-9705-445f-9ecd-5213968923fc tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:39.060279 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-88f9e235-9705-445f-9ecd-5213968923fc tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1576 microversion: 2.1 time: 0.624778 Jun 25 16:11:39.061574 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 323/641] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:38 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1576 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:40.078642 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-bd908cad-76c6-4ef8-9c05-65c8b274512c tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:40.079326 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-bd908cad-76c6-4ef8-9c05-65c8b274512c tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:40.089869 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:11:40.091884 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd908cad-76c6-4ef8-9c05-65c8b274512c tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:40.092364 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd908cad-76c6-4ef8-9c05-65c8b274512c tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:40.093167 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd908cad-76c6-4ef8-9c05-65c8b274512c tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:40.097493 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd908cad-76c6-4ef8-9c05-65c8b274512c tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:40.241423 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-d00d1a60-c90a-47dd-a667-a264f737444d req-df942e5d-0b0a-48a2-a64d-cc36679d4ec4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "749fc9b1-a969-425d-b2e4-a88b63a45ffe", "tag": "faf6b184-57b1-4bce-bc06-d6f249c9b017"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:11:40.252745 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-d00d1a60-c90a-47dd-a667-a264f737444d req-df942e5d-0b0a-48a2-a64d-cc36679d4ec4 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:40.253380 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-d00d1a60-c90a-47dd-a667-a264f737444d req-df942e5d-0b0a-48a2-a64d-cc36679d4ec4 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:40.268594 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-d00d1a60-c90a-47dd-a667-a264f737444d req-df942e5d-0b0a-48a2-a64d-cc36679d4ec4 service nova] Creating event network-changed:faf6b184-57b1-4bce-bc06-d6f249c9b017 for instance 749fc9b1-a969-425d-b2e4-a88b63a45ffe on hv-cinder-84762 Jun 25 16:11:40.281668 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-d00d1a60-c90a-47dd-a667-a264f737444d req-df942e5d-0b0a-48a2-a64d-cc36679d4ec4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.271115 Jun 25 16:11:40.284612 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 319/642] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:11:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:11:40.339284 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-bd908cad-76c6-4ef8-9c05-65c8b274512c tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:40.355165 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-bd908cad-76c6-4ef8-9c05-65c8b274512c tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1576 microversion: 2.1 time: 0.281190 Jun 25 16:11:40.356104 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 324/643] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:40 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1576 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:41.377197 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-f99c663b-7530-4133-b906-a004185a2503 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:41.378450 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-f99c663b-7530-4133-b906-a004185a2503 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:41.386909 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f99c663b-7530-4133-b906-a004185a2503 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:41.387743 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f99c663b-7530-4133-b906-a004185a2503 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:41.388816 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f99c663b-7530-4133-b906-a004185a2503 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:41.391037 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f99c663b-7530-4133-b906-a004185a2503 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:41.578809 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-f99c663b-7530-4133-b906-a004185a2503 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:41.587623 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-f99c663b-7530-4133-b906-a004185a2503 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1576 microversion: 2.1 time: 0.217627 Jun 25 16:11:41.588203 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 320/644] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:41 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1576 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:42.247996 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5cf13f8b-7e10-48df-8bc8-36ed2c36a19b tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Action: 'create', calling method: .version_select at 0x7f65bb64e430>, body: {"keypair": {"name": "tempest-keypair-1345989781", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbMbw2zwwIOCYCEclk9xL8Jh8QbHu3b+GcSPYi7kCuQVcEgr2ySD++1al+9rC1zSHiBGk9WrBw8NA40+3dnAjtfU9XH/HhRIT6E9lEFI/+HK64GrLyNiZvg6R/bWAislQ=="}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:11:42.261975 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-5cf13f8b-7e10-48df-8bc8-36ed2c36a19b tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Getting quotas for project 93ca9301bea041ce881109c706904a0a. Resources: {'key_pairs'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:11:42.266928 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-5cf13f8b-7e10-48df-8bc8-36ed2c36a19b tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Getting quotas for user 5c2141524dc546259cd993ace59e33f3 and project 93ca9301bea041ce881109c706904a0a. Resources: {'key_pairs'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:11:42.292137 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5cf13f8b-7e10-48df-8bc8-36ed2c36a19b tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.102144 Jun 25 16:11:42.292777 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 325/645] 10.222.0.13 () {60 vars in 1158 bytes} [Sat Jun 25 16:11:42 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:11:42.605877 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-1b721986-6067-41e6-8ef1-c68bf43990a7 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:42.607099 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-1b721986-6067-41e6-8ef1-c68bf43990a7 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:42.613888 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1b721986-6067-41e6-8ef1-c68bf43990a7 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:42.614459 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1b721986-6067-41e6-8ef1-c68bf43990a7 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:42.615850 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1b721986-6067-41e6-8ef1-c68bf43990a7 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:42.616290 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1b721986-6067-41e6-8ef1-c68bf43990a7 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:42.800488 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-1b721986-6067-41e6-8ef1-c68bf43990a7 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:42.810822 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-1b721986-6067-41e6-8ef1-c68bf43990a7 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1576 microversion: 2.1 time: 0.209381 Jun 25 16:11:42.812913 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 321/646] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:42 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1576 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:43.672944 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-302d8446-c401-46cf-9727-71469d3c5dda tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1526880492", "imageRef": "84c164fa-276d-4693-b7a0-24fd3024b359", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f17f727c-497a-440f-921d-f0ec313048f6"}], "security_groups": [{"name": "tempest-securitygroup--11776497"}], "key_name": "tempest-keypair-1345989781", "user_data": "}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:11:43.782377 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-302d8446-c401-46cf-9727-71469d3c5dda tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] validate_networks() for [('f17f727c-497a-440f-921d-f0ec313048f6', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 16:11:43.827131 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-dcef3770-671e-4535-ad8f-0aca71b789a1 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:43.827957 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-dcef3770-671e-4535-ad8f-0aca71b789a1 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:43.835514 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-dcef3770-671e-4535-ad8f-0aca71b789a1 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:43.835963 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-dcef3770-671e-4535-ad8f-0aca71b789a1 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:43.836793 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-dcef3770-671e-4535-ad8f-0aca71b789a1 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:43.837232 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-dcef3770-671e-4535-ad8f-0aca71b789a1 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:44.045621 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-dcef3770-671e-4535-ad8f-0aca71b789a1 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:44.053623 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-dcef3770-671e-4535-ad8f-0aca71b789a1 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1576 microversion: 2.1 time: 0.230320 Jun 25 16:11:44.054232 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 322/647] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:43 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1576 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:11:44.060257 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-8ec2f9d4-f3b7-4598-820d-3dafc8480c28 req-ca79bc44-5b32-4926-8668-0fee01fa0a70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "affce264-2942-4aa8-850e-96642d84eff3", "name": "network-vif-plugged", "status": "completed", "tag": "166dd48f-5e8c-48ce-8be5-c39460c7ef08"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:11:44.068636 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-8ec2f9d4-f3b7-4598-820d-3dafc8480c28 req-ca79bc44-5b32-4926-8668-0fee01fa0a70 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:44.069376 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-8ec2f9d4-f3b7-4598-820d-3dafc8480c28 req-ca79bc44-5b32-4926-8668-0fee01fa0a70 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:44.082382 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-8ec2f9d4-f3b7-4598-820d-3dafc8480c28 req-ca79bc44-5b32-4926-8668-0fee01fa0a70 service nova] Creating event network-vif-plugged:166dd48f-5e8c-48ce-8be5-c39460c7ef08 for instance affce264-2942-4aa8-850e-96642d84eff3 on hv-cinder-84762 Jun 25 16:11:44.087481 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-8ec2f9d4-f3b7-4598-820d-3dafc8480c28 req-ca79bc44-5b32-4926-8668-0fee01fa0a70 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031298 Jun 25 16:11:44.088091 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 323/648] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:11:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:11:44.282054 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-302d8446-c401-46cf-9727-71469d3c5dda tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 16:11:44.282520 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-302d8446-c401-46cf-9727-71469d3c5dda tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 16:11:44.282986 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-302d8446-c401-46cf-9727-71469d3c5dda tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 16:11:44.283387 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-302d8446-c401-46cf-9727-71469d3c5dda tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 16:11:44.283789 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-302d8446-c401-46cf-9727-71469d3c5dda tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 16:11:44.292959 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-302d8446-c401-46cf-9727-71469d3c5dda tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:44.293402 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-302d8446-c401-46cf-9727-71469d3c5dda tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:44.294197 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-302d8446-c401-46cf-9727-71469d3c5dda tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:44.294634 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-302d8446-c401-46cf-9727-71469d3c5dda tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:44.312510 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-302d8446-c401-46cf-9727-71469d3c5dda tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Getting quotas for project 93ca9301bea041ce881109c706904a0a. Resources: {'ram', 'cores', 'instances'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:11:44.317009 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-302d8446-c401-46cf-9727-71469d3c5dda tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Getting quotas for user 5c2141524dc546259cd993ace59e33f3 and project 93ca9301bea041ce881109c706904a0a. Resources: {'ram', 'cores', 'instances'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:11:44.329226 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-302d8446-c401-46cf-9727-71469d3c5dda tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 16:11:44.331544 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-302d8446-c401-46cf-9727-71469d3c5dda tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84c164fa-276d-4693-b7a0-24fd3024b359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 16:11:44.381462 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-302d8446-c401-46cf-9727-71469d3c5dda tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.714121 Jun 25 16:11:44.382276 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 326/649] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Jun 25 16:11:43 2022] POST /compute/v2.1/servers => generated 400 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 16:11:44.393117 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-cfb17cef-dc50-4f77-8b83-b0d9c9b65fd6 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:44.393821 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-cfb17cef-dc50-4f77-8b83-b0d9c9b65fd6 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:44.454208 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-cfb17cef-dc50-4f77-8b83-b0d9c9b65fd6 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:44.461188 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-cfb17cef-dc50-4f77-8b83-b0d9c9b65fd6 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1238 microversion: 2.1 time: 0.072860 Jun 25 16:11:44.461857 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 324/650] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:44 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1238 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:45.073524 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-882cb7e2-f897-4477-ab6e-d2e00914834e tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:45.075010 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-882cb7e2-f897-4477-ab6e-d2e00914834e tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:45.084951 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-882cb7e2-f897-4477-ab6e-d2e00914834e tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:45.085853 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-882cb7e2-f897-4477-ab6e-d2e00914834e tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:45.087179 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-882cb7e2-f897-4477-ab6e-d2e00914834e tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:45.087987 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-882cb7e2-f897-4477-ab6e-d2e00914834e tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:45.240616 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-882cb7e2-f897-4477-ab6e-d2e00914834e tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:45.248690 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-882cb7e2-f897-4477-ab6e-d2e00914834e tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1576 microversion: 2.1 time: 0.180570 Jun 25 16:11:45.249484 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 327/651] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:45 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1576 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:45.478408 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-924da868-7e5b-45ea-b6e0-71093bf5ceda tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:45.479769 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-924da868-7e5b-45ea-b6e0-71093bf5ceda tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:45.487590 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-924da868-7e5b-45ea-b6e0-71093bf5ceda tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:45.488172 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-924da868-7e5b-45ea-b6e0-71093bf5ceda tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:45.489117 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-924da868-7e5b-45ea-b6e0-71093bf5ceda tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:45.489670 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-924da868-7e5b-45ea-b6e0-71093bf5ceda tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:45.559697 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-924da868-7e5b-45ea-b6e0-71093bf5ceda tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:45.567891 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-924da868-7e5b-45ea-b6e0-71093bf5ceda tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1290 microversion: 2.1 time: 0.093487 Jun 25 16:11:45.568482 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 325/652] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:45 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1290 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:46.270816 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a3e6b0d4-7294-4703-b737-d709f616f310 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:46.272010 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a3e6b0d4-7294-4703-b737-d709f616f310 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:46.287057 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a3e6b0d4-7294-4703-b737-d709f616f310 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:46.287842 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a3e6b0d4-7294-4703-b737-d709f616f310 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:46.288799 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a3e6b0d4-7294-4703-b737-d709f616f310 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:46.289375 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a3e6b0d4-7294-4703-b737-d709f616f310 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:46.467956 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a3e6b0d4-7294-4703-b737-d709f616f310 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:46.477258 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a3e6b0d4-7294-4703-b737-d709f616f310 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1563 microversion: 2.1 time: 0.213597 Jun 25 16:11:46.477894 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 328/653] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:46 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1563 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:46.586103 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-53dea693-1da0-4bae-88b4-e59feea67ec3 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:46.587579 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-53dea693-1da0-4bae-88b4-e59feea67ec3 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:46.594898 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-53dea693-1da0-4bae-88b4-e59feea67ec3 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:46.595587 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-53dea693-1da0-4bae-88b4-e59feea67ec3 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:46.596780 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-53dea693-1da0-4bae-88b4-e59feea67ec3 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:46.597800 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-53dea693-1da0-4bae-88b4-e59feea67ec3 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:46.665741 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-53dea693-1da0-4bae-88b4-e59feea67ec3 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:46.674480 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-53dea693-1da0-4bae-88b4-e59feea67ec3 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1296 microversion: 2.1 time: 0.092317 Jun 25 16:11:46.675916 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 326/654] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:46 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1296 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:47.694944 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f8fbe5a9-0f2e-432b-8c05-a232b95744b1 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:47.695771 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f8fbe5a9-0f2e-432b-8c05-a232b95744b1 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:47.704580 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f8fbe5a9-0f2e-432b-8c05-a232b95744b1 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:47.705023 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f8fbe5a9-0f2e-432b-8c05-a232b95744b1 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:47.705996 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f8fbe5a9-0f2e-432b-8c05-a232b95744b1 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:47.706430 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f8fbe5a9-0f2e-432b-8c05-a232b95744b1 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:47.875384 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f8fbe5a9-0f2e-432b-8c05-a232b95744b1 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:47.885974 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f8fbe5a9-0f2e-432b-8c05-a232b95744b1 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1362 microversion: 2.1 time: 0.194673 Jun 25 16:11:47.891234 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 329/655] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:47 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1362 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:47.919236 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-5eaec7ee-2db2-4681-bd4b-2a178e97505c req-73462c38-f8bf-4ef6-a48c-259a2e0caed4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0460a39-cea4-4afc-92b3-091c5a768695", "tag": "4f5f9d67-66aa-4e41-9fa6-b9aeeb540e5c"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:11:47.929343 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-5eaec7ee-2db2-4681-bd4b-2a178e97505c req-73462c38-f8bf-4ef6-a48c-259a2e0caed4 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:47.929988 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-5eaec7ee-2db2-4681-bd4b-2a178e97505c req-73462c38-f8bf-4ef6-a48c-259a2e0caed4 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:47.945597 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-5eaec7ee-2db2-4681-bd4b-2a178e97505c req-73462c38-f8bf-4ef6-a48c-259a2e0caed4 service nova] Creating event network-changed:4f5f9d67-66aa-4e41-9fa6-b9aeeb540e5c for instance d0460a39-cea4-4afc-92b3-091c5a768695 on hv-cinder-84762 Jun 25 16:11:47.950881 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-5eaec7ee-2db2-4681-bd4b-2a178e97505c req-73462c38-f8bf-4ef6-a48c-259a2e0caed4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.121817 Jun 25 16:11:47.951487 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 327/656] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:11:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:11:48.903439 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d8fa35ed-2509-405d-8351-a001c67aec0d tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:48.904037 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d8fa35ed-2509-405d-8351-a001c67aec0d tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:48.911161 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d8fa35ed-2509-405d-8351-a001c67aec0d tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:48.911601 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d8fa35ed-2509-405d-8351-a001c67aec0d tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:48.912357 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d8fa35ed-2509-405d-8351-a001c67aec0d tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:48.912821 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d8fa35ed-2509-405d-8351-a001c67aec0d tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:49.043502 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d8fa35ed-2509-405d-8351-a001c67aec0d tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:49.051537 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d8fa35ed-2509-405d-8351-a001c67aec0d tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1362 microversion: 2.1 time: 0.152036 Jun 25 16:11:49.052109 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 330/657] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:48 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:50.073239 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-a8015b4a-6c3c-4e5a-91df-abf6cdc5d30b tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:50.073966 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-a8015b4a-6c3c-4e5a-91df-abf6cdc5d30b tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:50.075942 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:11:50.082697 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a8015b4a-6c3c-4e5a-91df-abf6cdc5d30b tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:50.083279 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a8015b4a-6c3c-4e5a-91df-abf6cdc5d30b tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:50.084051 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a8015b4a-6c3c-4e5a-91df-abf6cdc5d30b tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:50.084516 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a8015b4a-6c3c-4e5a-91df-abf6cdc5d30b tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:50.218684 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-a8015b4a-6c3c-4e5a-91df-abf6cdc5d30b tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:50.226599 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-a8015b4a-6c3c-4e5a-91df-abf6cdc5d30b tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1362 microversion: 2.1 time: 0.158364 Jun 25 16:11:50.227170 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 328/658] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:50 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:51.247353 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-821f77b8-d588-4ff1-bd7c-86627f789005 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:51.248306 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-821f77b8-d588-4ff1-bd7c-86627f789005 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:51.259798 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-821f77b8-d588-4ff1-bd7c-86627f789005 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:51.260601 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-821f77b8-d588-4ff1-bd7c-86627f789005 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:51.261864 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-821f77b8-d588-4ff1-bd7c-86627f789005 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:51.262584 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-821f77b8-d588-4ff1-bd7c-86627f789005 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:51.409878 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-821f77b8-d588-4ff1-bd7c-86627f789005 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:51.417405 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-821f77b8-d588-4ff1-bd7c-86627f789005 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1362 microversion: 2.1 time: 0.176684 Jun 25 16:11:51.417972 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 331/659] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:51 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:51.892264 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-56983614-2bfb-4a12-86c8-0a417c1dc24f req-bf23ee8a-0afe-4876-88b3-83fc01ea8fca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0460a39-cea4-4afc-92b3-091c5a768695", "name": "network-vif-plugged", "status": "completed", "tag": "4f5f9d67-66aa-4e41-9fa6-b9aeeb540e5c"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:11:51.901655 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-56983614-2bfb-4a12-86c8-0a417c1dc24f req-bf23ee8a-0afe-4876-88b3-83fc01ea8fca service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:51.902104 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-56983614-2bfb-4a12-86c8-0a417c1dc24f req-bf23ee8a-0afe-4876-88b3-83fc01ea8fca service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:51.913194 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-56983614-2bfb-4a12-86c8-0a417c1dc24f req-bf23ee8a-0afe-4876-88b3-83fc01ea8fca service nova] Creating event network-vif-plugged:4f5f9d67-66aa-4e41-9fa6-b9aeeb540e5c for instance d0460a39-cea4-4afc-92b3-091c5a768695 on hv-cinder-84762 Jun 25 16:11:51.917938 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-56983614-2bfb-4a12-86c8-0a417c1dc24f req-bf23ee8a-0afe-4876-88b3-83fc01ea8fca service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030017 Jun 25 16:11:51.918536 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 329/660] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:11:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:11:52.434572 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8ba56b31-94c8-49c4-805d-eb522ff09707 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:52.435170 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8ba56b31-94c8-49c4-805d-eb522ff09707 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:52.442221 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8ba56b31-94c8-49c4-805d-eb522ff09707 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:52.442783 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8ba56b31-94c8-49c4-805d-eb522ff09707 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:52.443586 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8ba56b31-94c8-49c4-805d-eb522ff09707 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:52.444019 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8ba56b31-94c8-49c4-805d-eb522ff09707 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:52.577494 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8ba56b31-94c8-49c4-805d-eb522ff09707 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:52.585384 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8ba56b31-94c8-49c4-805d-eb522ff09707 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1362 microversion: 2.1 time: 0.154729 Jun 25 16:11:52.585952 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 332/661] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:52 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:53.604445 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-74ca639f-7da0-4589-85bf-bf99fc794eda tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:53.605342 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-74ca639f-7da0-4589-85bf-bf99fc794eda tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:53.612751 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-74ca639f-7da0-4589-85bf-bf99fc794eda tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:53.613232 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-74ca639f-7da0-4589-85bf-bf99fc794eda tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:53.614098 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-74ca639f-7da0-4589-85bf-bf99fc794eda tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:53.614575 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-74ca639f-7da0-4589-85bf-bf99fc794eda tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:53.645058 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1351889f-4cbd-4d49-8a75-b769a5a3c049 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:53.645621 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1351889f-4cbd-4d49-8a75-b769a5a3c049 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 2db6cecf-c268-4ee6-a745-6e2130e594bb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:53.652393 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1351889f-4cbd-4d49-8a75-b769a5a3c049 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:53.652855 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1351889f-4cbd-4d49-8a75-b769a5a3c049 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:53.653623 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1351889f-4cbd-4d49-8a75-b769a5a3c049 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:53.654055 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1351889f-4cbd-4d49-8a75-b769a5a3c049 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:53.677709 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1351889f-4cbd-4d49-8a75-b769a5a3c049 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb/ips" status: 200 len: 150 microversion: 2.1 time: 0.036394 Jun 25 16:11:53.678974 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 333/662] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Jun 25 16:11:53 2022] GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:11:53.762021 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-74ca639f-7da0-4589-85bf-bf99fc794eda tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:53.770328 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-74ca639f-7da0-4589-85bf-bf99fc794eda tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1362 microversion: 2.1 time: 0.170980 Jun 25 16:11:53.780159 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 330/663] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:53 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1362 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:54.787551 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4a2aa5f6-f371-4365-b8f4-aed6d8a252ad tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:54.789165 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4a2aa5f6-f371-4365-b8f4-aed6d8a252ad tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:54.790019 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:11:54.790737 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=10 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:11:54.797363 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4a2aa5f6-f371-4365-b8f4-aed6d8a252ad tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:54.797811 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4a2aa5f6-f371-4365-b8f4-aed6d8a252ad tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:54.798577 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4a2aa5f6-f371-4365-b8f4-aed6d8a252ad tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:54.799009 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4a2aa5f6-f371-4365-b8f4-aed6d8a252ad tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:54.938800 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4a2aa5f6-f371-4365-b8f4-aed6d8a252ad tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:11:54.946746 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4a2aa5f6-f371-4365-b8f4-aed6d8a252ad tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1548 microversion: 2.1 time: 0.163128 Jun 25 16:11:54.947319 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 334/664] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:11:54 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1548 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:11:54.963609 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-2e2704ea-4b23-4dff-8d99-a199195ad527 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:11:54.964216 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-2e2704ea-4b23-4dff-8d99-a199195ad527 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:54.966660 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell0:SELECT=2 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:11:54.972581 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2e2704ea-4b23-4dff-8d99-a199195ad527 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:54.973039 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2e2704ea-4b23-4dff-8d99-a199195ad527 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:54.973818 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2e2704ea-4b23-4dff-8d99-a199195ad527 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:54.974258 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2e2704ea-4b23-4dff-8d99-a199195ad527 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:54.978395 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=100 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:11:55.004571 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-41573fe2-50c7-43cf-aa49-08687121c74f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9e717d73-4f23-46d3-9caf-4bf87a270b45"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:11:55.005771 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-41573fe2-50c7-43cf-aa49-08687121c74f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 2db6cecf-c268-4ee6-a745-6e2130e594bb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:11:55.012314 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-41573fe2-50c7-43cf-aa49-08687121c74f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:55.012644 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-41573fe2-50c7-43cf-aa49-08687121c74f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:55.013422 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-41573fe2-50c7-43cf-aa49-08687121c74f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:55.013865 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-41573fe2-50c7-43cf-aa49-08687121c74f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:55.052919 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-2e2704ea-4b23-4dff-8d99-a199195ad527 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093192 Jun 25 16:11:55.054296 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 331/665] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Jun 25 16:11:54 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:11:55.261257 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-41573fe2-50c7-43cf-aa49-08687121c74f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "POST /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260584 Jun 25 16:11:55.261880 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 335/666] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Jun 25 16:11:54 2022] POST /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:11:56.013442 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-a1d520b9-396d-4d60-933f-20be35f749f9 req-e7cedc3c-30a5-4121-8ac8-01050c277a5c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0460a39-cea4-4afc-92b3-091c5a768695", "tag": "4f5f9d67-66aa-4e41-9fa6-b9aeeb540e5c"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:11:56.022115 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-a1d520b9-396d-4d60-933f-20be35f749f9 req-e7cedc3c-30a5-4121-8ac8-01050c277a5c service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:11:56.022552 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-a1d520b9-396d-4d60-933f-20be35f749f9 req-e7cedc3c-30a5-4121-8ac8-01050c277a5c service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:11:56.034087 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-a1d520b9-396d-4d60-933f-20be35f749f9 req-e7cedc3c-30a5-4121-8ac8-01050c277a5c service nova] Creating event network-changed:4f5f9d67-66aa-4e41-9fa6-b9aeeb540e5c for instance d0460a39-cea4-4afc-92b3-091c5a768695 on hv-cinder-84762 Jun 25 16:11:56.039029 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-a1d520b9-396d-4d60-933f-20be35f749f9 req-e7cedc3c-30a5-4121-8ac8-01050c277a5c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029753 Jun 25 16:11:56.039943 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 332/667] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:12:01.845678 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-17e7f32f-92af-4a3b-9190-dc72c096df66 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:01.846263 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-17e7f32f-92af-4a3b-9190-dc72c096df66 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 2db6cecf-c268-4ee6-a745-6e2130e594bb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:01.852753 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-17e7f32f-92af-4a3b-9190-dc72c096df66 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:01.853197 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-17e7f32f-92af-4a3b-9190-dc72c096df66 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:01.853947 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-17e7f32f-92af-4a3b-9190-dc72c096df66 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:01.854379 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-17e7f32f-92af-4a3b-9190-dc72c096df66 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:01.939412 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-17e7f32f-92af-4a3b-9190-dc72c096df66 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lazy-loading 'services' on Instance uuid 2db6cecf-c268-4ee6-a745-6e2130e594bb {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 16:12:02.015890 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-17e7f32f-92af-4a3b-9190-dc72c096df66 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb/os-volume_attachments/9e717d73-4f23-46d3-9caf-4bf87a270b45" status: 202 len: 0 microversion: 2.1 time: 0.175601 Jun 25 16:12:02.016549 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 336/668] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Jun 25 16:12:01 2022] DELETE /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb/os-volume_attachments/9e717d73-4f23-46d3-9caf-4bf87a270b45 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 16:12:02.026330 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-7ea08297-275f-4e2f-acdb-489f1d8712c1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:02.027351 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-7ea08297-275f-4e2f-acdb-489f1d8712c1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 2db6cecf-c268-4ee6-a745-6e2130e594bb] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:02.034625 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7ea08297-275f-4e2f-acdb-489f1d8712c1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:02.035179 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7ea08297-275f-4e2f-acdb-489f1d8712c1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:02.035979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7ea08297-275f-4e2f-acdb-489f1d8712c1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:02.036581 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7ea08297-275f-4e2f-acdb-489f1d8712c1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:02.071365 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-7ea08297-275f-4e2f-acdb-489f1d8712c1 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050067 Jun 25 16:12:02.071894 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 333/669] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Jun 25 16:12:02 2022] GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:12:03.084812 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c388939f-1c51-4783-a69e-f89c22bcbc4f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:03.085873 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c388939f-1c51-4783-a69e-f89c22bcbc4f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 2db6cecf-c268-4ee6-a745-6e2130e594bb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:03.092861 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c388939f-1c51-4783-a69e-f89c22bcbc4f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:03.093329 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c388939f-1c51-4783-a69e-f89c22bcbc4f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:03.094096 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c388939f-1c51-4783-a69e-f89c22bcbc4f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:03.094559 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c388939f-1c51-4783-a69e-f89c22bcbc4f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:03.123515 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c388939f-1c51-4783-a69e-f89c22bcbc4f tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043587 Jun 25 16:12:03.124082 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 337/670] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Jun 25 16:12:03 2022] GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 16:12:03.190736 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-58ee9601-6d87-4241-adb2-715fd47018ab tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:03.191235 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-58ee9601-6d87-4241-adb2-715fd47018ab tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 2db6cecf-c268-4ee6-a745-6e2130e594bb] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:03.201613 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-58ee9601-6d87-4241-adb2-715fd47018ab tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:03.202200 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-58ee9601-6d87-4241-adb2-715fd47018ab tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:03.203025 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-58ee9601-6d87-4241-adb2-715fd47018ab tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:03.203463 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-58ee9601-6d87-4241-adb2-715fd47018ab tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:03.228769 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-58ee9601-6d87-4241-adb2-715fd47018ab tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 2db6cecf-c268-4ee6-a745-6e2130e594bb] Going to try to terminate instance {{(pid=117794) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 16:12:03.319435 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-58ee9601-6d87-4241-adb2-715fd47018ab tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb" status: 204 len: 0 microversion: 2.1 time: 0.134486 Jun 25 16:12:03.320177 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 334/671] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Jun 25 16:12:03 2022] DELETE /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 16:12:03.328698 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-79ca4b05-4962-4ccf-bae3-c6ee813fc487 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:03.329315 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-79ca4b05-4962-4ccf-bae3-c6ee813fc487 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 2db6cecf-c268-4ee6-a745-6e2130e594bb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:03.335396 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-79ca4b05-4962-4ccf-bae3-c6ee813fc487 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:03.335841 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-79ca4b05-4962-4ccf-bae3-c6ee813fc487 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:03.336623 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-79ca4b05-4962-4ccf-bae3-c6ee813fc487 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:03.337053 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-79ca4b05-4962-4ccf-bae3-c6ee813fc487 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:03.472071 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-79ca4b05-4962-4ccf-bae3-c6ee813fc487 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:03.479985 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-79ca4b05-4962-4ccf-bae3-c6ee813fc487 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb" status: 200 len: 1680 microversion: 2.1 time: 0.155475 Jun 25 16:12:03.480622 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 338/672] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:12:03 2022] GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:12:04.502940 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-dea3c162-b2e1-492e-988c-60bd08398c48 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:04.504090 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-dea3c162-b2e1-492e-988c-60bd08398c48 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 2db6cecf-c268-4ee6-a745-6e2130e594bb] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:04.515446 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-dea3c162-b2e1-492e-988c-60bd08398c48 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:04.515891 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-dea3c162-b2e1-492e-988c-60bd08398c48 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:04.516701 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-dea3c162-b2e1-492e-988c-60bd08398c48 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:04.517131 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-dea3c162-b2e1-492e-988c-60bd08398c48 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:04.656173 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-dea3c162-b2e1-492e-988c-60bd08398c48 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:04.667749 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-dea3c162-b2e1-492e-988c-60bd08398c48 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb" status: 200 len: 1680 microversion: 2.1 time: 0.171733 Jun 25 16:12:04.668464 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 335/673] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:12:04 2022] GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:12:05.686773 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-133b50c1-c785-4f1b-b7e2-725fd0f67493 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:05.687574 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-133b50c1-c785-4f1b-b7e2-725fd0f67493 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 2db6cecf-c268-4ee6-a745-6e2130e594bb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:05.694431 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-133b50c1-c785-4f1b-b7e2-725fd0f67493 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:05.694887 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-133b50c1-c785-4f1b-b7e2-725fd0f67493 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:05.695653 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-133b50c1-c785-4f1b-b7e2-725fd0f67493 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:05.696091 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-133b50c1-c785-4f1b-b7e2-725fd0f67493 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:05.715515 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:12:05.763064 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-133b50c1-c785-4f1b-b7e2-725fd0f67493 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19140330ae664e45b85f47f321496191', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1bba8f74dbd433bbffdb2ffbfc481fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:05.771788 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-133b50c1-c785-4f1b-b7e2-725fd0f67493 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb" status: 200 len: 1613 microversion: 2.1 time: 0.089137 Jun 25 16:12:05.772648 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 339/674] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:12:05 2022] GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb => generated 1613 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:12:06.134213 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-af65ad72-635e-4b8c-b90a-90dfeb01afee req-4af08813-5a5f-495f-b289-a0cd53032702 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2db6cecf-c268-4ee6-a745-6e2130e594bb", "name": "network-vif-deleted", "tag": "172ac5a0-4d98-42ad-b245-4ffe24d39dde"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:12:06.144214 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-af65ad72-635e-4b8c-b90a-90dfeb01afee req-4af08813-5a5f-495f-b289-a0cd53032702 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:06.144808 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-af65ad72-635e-4b8c-b90a-90dfeb01afee req-4af08813-5a5f-495f-b289-a0cd53032702 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:06.157235 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-af65ad72-635e-4b8c-b90a-90dfeb01afee req-4af08813-5a5f-495f-b289-a0cd53032702 service nova] Creating event network-vif-deleted:172ac5a0-4d98-42ad-b245-4ffe24d39dde for instance 2db6cecf-c268-4ee6-a745-6e2130e594bb on hv-cinder-84762 Jun 25 16:12:06.162742 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-af65ad72-635e-4b8c-b90a-90dfeb01afee req-4af08813-5a5f-495f-b289-a0cd53032702 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032388 Jun 25 16:12:06.163373 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 336/675] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:12:06.789383 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-19adffc6-0fb6-4389-b3f7-6076b13c3f9e tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:06.789998 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-19adffc6-0fb6-4389-b3f7-6076b13c3f9e tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 2db6cecf-c268-4ee6-a745-6e2130e594bb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:06.797459 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-19adffc6-0fb6-4389-b3f7-6076b13c3f9e tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:06.797895 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-19adffc6-0fb6-4389-b3f7-6076b13c3f9e tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:06.798671 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-19adffc6-0fb6-4389-b3f7-6076b13c3f9e tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:06.799109 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-19adffc6-0fb6-4389-b3f7-6076b13c3f9e tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:06.813740 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-19adffc6-0fb6-4389-b3f7-6076b13c3f9e tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] HTTP exception thrown: Instance 2db6cecf-c268-4ee6-a745-6e2130e594bb could not be found. Jun 25 16:12:06.815401 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-19adffc6-0fb6-4389-b3f7-6076b13c3f9e tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Request method failure captured: Jun 25 16:12:06.815401 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb HTTP/1.1 Jun 25 16:12:06.815401 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept: application/json Jun 25 16:12:06.815401 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jun 25 16:12:06.815401 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Connection: close Jun 25 16:12:06.815401 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jun 25 16:12:06.815401 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jun 25 16:12:06.815401 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Host: 10.222.0.13 Jun 25 16:12:06.815401 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jun 25 16:12:06.815401 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jun 25 16:12:06.815401 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABitzJ4VTX9FBO09dP9eDUNJ7kXDvOeQ_3800jobL_5yAtOgxQI54WUI0jlTKIeeP5rTVj0MTWBlkUxqhr419kWtC1O7I2ACk-hIdi2fMzwDg3khIX53lL7PAAWZJjGvTHF0eyDgeSSmpMCdU8rbC_7cLecxR6vp9KZlm3nwM3ZTo0XAYY Jun 25 16:12:06.815401 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jun 25 16:12:06.815401 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jun 25 16:12:06.815401 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jun 25 16:12:06.815401 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jun 25 16:12:06.815401 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jun 25 16:12:06.815401 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jun 25 16:12:06.815401 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Id: b1bba8f74dbd433bbffdb2ffbfc481fb Jun 25 16:12:06.815401 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:12:06.815401 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Role: reader,member Jun 25 16:12:06.815401 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Jun 25 16:12:06.816827 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b1bba8f74dbd433bbffdb2ffbfc481fb", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:12:06.816827 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:12:06.816827 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Id: b1bba8f74dbd433bbffdb2ffbfc481fb Jun 25 16:12:06.816827 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:12:06.816827 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeNegativeTest-1137598465-project Jun 25 16:12:06.816827 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jun 25 16:12:06.816827 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jun 25 16:12:06.816827 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Id: 19140330ae664e45b85f47f321496191 Jun 25 16:12:06.816827 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeNegativeTest-1137598465-project Jun 25 16:12:06.816827 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: method: > Jun 25 16:12:06.816827 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: exception: Instance 2db6cecf-c268-4ee6-a745-6e2130e594bb could not be found. Jun 25 16:12:06.816827 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: action_args: {'id': '2db6cecf-c268-4ee6-a745-6e2130e594bb'} Jun 25 16:12:06.817588 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:12:06.817588 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:12:06.817588 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:12:06.817588 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:12:06.817588 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:12:06.817588 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:12:06.817588 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:12:06.817588 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:12:06.817588 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:12:06.817588 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:12:06.817588 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2db6cecf-c268-4ee6-a745-6e2130e594bb could not be found. Jun 25 16:12:06.817588 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:12:06.817588 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:12:06.817588 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:12:06.817588 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:12:06.817588 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:12:06.817588 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:12:06.817588 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:12:06.817588 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:12:06.817588 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:12:06.818885 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:12:06.818885 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 16:12:06.818885 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 16:12:06.818885 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:12:06.818885 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:12:06.818885 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:12:06.818885 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:12:06.818885 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2db6cecf-c268-4ee6-a745-6e2130e594bb could not be found. Jun 25 16:12:06.818885 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:12:06.818885 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:12:06.818885 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:12:06.818885 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:12:06.818885 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:12:06.818885 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:12:06.818885 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:12:06.818885 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:12:06.818885 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2db6cecf-c268-4ee6-a745-6e2130e594bb could not be found. Jun 25 16:12:06.818885 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:12:06.820022 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-19adffc6-0fb6-4389-b3f7-6076b13c3f9e tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Returning 404 to user: Instance 2db6cecf-c268-4ee6-a745-6e2130e594bb could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:12:06.820022 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-19adffc6-0fb6-4389-b3f7-6076b13c3f9e tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb" status: 404 len: 111 microversion: 2.1 time: 0.031748 Jun 25 16:12:06.820022 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 340/676] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:12:06 2022] GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:12:06.826648 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-0f5f656e-dcb8-4537-b2e6-6cde0834d557 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '.version_select at 0x7f65bb5dd1f0>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:06.845428 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-0f5f656e-dcb8-4537-b2e6-6cde0834d557 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-59998206" status: 202 len: 0 microversion: 2.1 time: 0.022893 Jun 25 16:12:06.846011 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 337/677] 10.222.0.13 () {58 vars in 1214 bytes} [Sat Jun 25 16:12:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-59998206 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 16:12:08.614303 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3d16e94b-aa7e-4728-b285-6ae7f7960771 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:08.614821 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3d16e94b-aa7e-4728-b285-6ae7f7960771 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 2db6cecf-c268-4ee6-a745-6e2130e594bb] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:08.621688 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3d16e94b-aa7e-4728-b285-6ae7f7960771 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:08.622128 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3d16e94b-aa7e-4728-b285-6ae7f7960771 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:08.622877 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3d16e94b-aa7e-4728-b285-6ae7f7960771 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:08.623304 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3d16e94b-aa7e-4728-b285-6ae7f7960771 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:08.636986 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-3d16e94b-aa7e-4728-b285-6ae7f7960771 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] HTTP exception thrown: Instance 2db6cecf-c268-4ee6-a745-6e2130e594bb could not be found. Jun 25 16:12:08.638542 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3d16e94b-aa7e-4728-b285-6ae7f7960771 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Request method failure captured: Jun 25 16:12:08.638542 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: request: DELETE /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb HTTP/1.1 Jun 25 16:12:08.638542 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept: application/json Jun 25 16:12:08.638542 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jun 25 16:12:08.638542 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Connection: close Jun 25 16:12:08.638542 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jun 25 16:12:08.638542 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jun 25 16:12:08.638542 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Host: 10.222.0.13 Jun 25 16:12:08.638542 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jun 25 16:12:08.638542 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jun 25 16:12:08.638542 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABitzJ4VTX9FBO09dP9eDUNJ7kXDvOeQ_3800jobL_5yAtOgxQI54WUI0jlTKIeeP5rTVj0MTWBlkUxqhr419kWtC1O7I2ACk-hIdi2fMzwDg3khIX53lL7PAAWZJjGvTHF0eyDgeSSmpMCdU8rbC_7cLecxR6vp9KZlm3nwM3ZTo0XAYY Jun 25 16:12:08.638542 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jun 25 16:12:08.638542 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jun 25 16:12:08.638542 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jun 25 16:12:08.638542 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jun 25 16:12:08.638542 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jun 25 16:12:08.638542 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jun 25 16:12:08.638542 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Id: b1bba8f74dbd433bbffdb2ffbfc481fb Jun 25 16:12:08.638542 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:12:08.638542 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Role: reader,member Jun 25 16:12:08.638542 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Jun 25 16:12:08.640499 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b1bba8f74dbd433bbffdb2ffbfc481fb", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:12:08.640499 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:12:08.640499 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Id: b1bba8f74dbd433bbffdb2ffbfc481fb Jun 25 16:12:08.640499 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:12:08.640499 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeNegativeTest-1137598465-project Jun 25 16:12:08.640499 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jun 25 16:12:08.640499 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jun 25 16:12:08.640499 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Id: 19140330ae664e45b85f47f321496191 Jun 25 16:12:08.640499 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeNegativeTest-1137598465-project Jun 25 16:12:08.640499 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: method: > Jun 25 16:12:08.640499 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: exception: Instance 2db6cecf-c268-4ee6-a745-6e2130e594bb could not be found. Jun 25 16:12:08.640499 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: action_args: {'id': '2db6cecf-c268-4ee6-a745-6e2130e594bb'} Jun 25 16:12:08.641332 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:12:08.641332 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:12:08.641332 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:12:08.641332 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:12:08.641332 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:12:08.641332 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:12:08.641332 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:12:08.641332 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:12:08.641332 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:12:08.641332 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:12:08.641332 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2db6cecf-c268-4ee6-a745-6e2130e594bb could not be found. Jun 25 16:12:08.641332 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:12:08.641332 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:12:08.641332 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:12:08.641332 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:12:08.641332 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:12:08.641332 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:12:08.641332 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:12:08.641332 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:12:08.641332 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:12:08.642775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:12:08.642775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 16:12:08.642775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 16:12:08.642775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 16:12:08.642775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 16:12:08.642775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:12:08.642775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:12:08.642775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:12:08.642775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:12:08.642775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2db6cecf-c268-4ee6-a745-6e2130e594bb could not be found. Jun 25 16:12:08.642775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:12:08.642775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:12:08.642775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:12:08.642775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:12:08.642775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:12:08.642775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:12:08.642775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:12:08.642775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:12:08.642775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2db6cecf-c268-4ee6-a745-6e2130e594bb could not be found. Jun 25 16:12:08.642775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:12:08.644226 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3d16e94b-aa7e-4728-b285-6ae7f7960771 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Returning 404 to user: Instance 2db6cecf-c268-4ee6-a745-6e2130e594bb could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:12:08.644226 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3d16e94b-aa7e-4728-b285-6ae7f7960771 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb" status: 404 len: 111 microversion: 2.1 time: 0.029796 Jun 25 16:12:08.644226 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 341/678] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Jun 25 16:12:08 2022] DELETE /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:12:08.649617 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-2c9741cd-1cb4-4324-bae3-3f1f1133c1d4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:08.650349 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-2c9741cd-1cb4-4324-bae3-3f1f1133c1d4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 2db6cecf-c268-4ee6-a745-6e2130e594bb] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:08.657556 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2c9741cd-1cb4-4324-bae3-3f1f1133c1d4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:08.657997 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2c9741cd-1cb4-4324-bae3-3f1f1133c1d4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:08.658791 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2c9741cd-1cb4-4324-bae3-3f1f1133c1d4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:08.659232 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2c9741cd-1cb4-4324-bae3-3f1f1133c1d4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:08.673213 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.wsgi [None req-2c9741cd-1cb4-4324-bae3-3f1f1133c1d4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] HTTP exception thrown: Instance 2db6cecf-c268-4ee6-a745-6e2130e594bb could not be found. Jun 25 16:12:08.674857 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-2c9741cd-1cb4-4324-bae3-3f1f1133c1d4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Request method failure captured: Jun 25 16:12:08.674857 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: request: GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb HTTP/1.1 Jun 25 16:12:08.674857 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept: application/json Jun 25 16:12:08.674857 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept-Encoding: identity Jun 25 16:12:08.674857 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Connection: close Jun 25 16:12:08.674857 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Length: 0 Jun 25 16:12:08.674857 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Type: application/json Jun 25 16:12:08.674857 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Host: 10.222.0.13 Jun 25 16:12:08.674857 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Openstack-System-Scope: None Jun 25 16:12:08.674857 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: User-Agent: python-urllib3/1.26.9 Jun 25 16:12:08.674857 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Auth-Token: gAAAAABitzJ4VTX9FBO09dP9eDUNJ7kXDvOeQ_3800jobL_5yAtOgxQI54WUI0jlTKIeeP5rTVj0MTWBlkUxqhr419kWtC1O7I2ACk-hIdi2fMzwDg3khIX53lL7PAAWZJjGvTHF0eyDgeSSmpMCdU8rbC_7cLecxR6vp9KZlm3nwM3ZTo0XAYY Jun 25 16:12:08.674857 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Id: None Jun 25 16:12:08.674857 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Name: None Jun 25 16:12:08.674857 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Identity-Status: Confirmed Jun 25 16:12:08.674857 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Is-Admin-Project: True Jun 25 16:12:08.674857 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Id: default Jun 25 16:12:08.674857 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Name: Default Jun 25 16:12:08.674857 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Id: b1bba8f74dbd433bbffdb2ffbfc481fb Jun 25 16:12:08.674857 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Name: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:12:08.674857 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Role: reader,member Jun 25 16:12:08.674857 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Roles: reader,member Jun 25 16:12:08.676331 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b1bba8f74dbd433bbffdb2ffbfc481fb", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:12:08.676331 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:12:08.676331 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Id: b1bba8f74dbd433bbffdb2ffbfc481fb Jun 25 16:12:08.676331 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:12:08.676331 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User: tempest-AttachVolumeNegativeTest-1137598465-project Jun 25 16:12:08.676331 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Id: default Jun 25 16:12:08.676331 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Name: Default Jun 25 16:12:08.676331 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Id: 19140330ae664e45b85f47f321496191 Jun 25 16:12:08.676331 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Name: tempest-AttachVolumeNegativeTest-1137598465-project Jun 25 16:12:08.676331 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: method: > Jun 25 16:12:08.676331 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: exception: Instance 2db6cecf-c268-4ee6-a745-6e2130e594bb could not be found. Jun 25 16:12:08.676331 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: action_args: {'id': '2db6cecf-c268-4ee6-a745-6e2130e594bb'} Jun 25 16:12:08.677176 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:12:08.677176 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:12:08.677176 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:12:08.677176 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:12:08.677176 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:12:08.677176 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:12:08.677176 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:12:08.677176 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:12:08.677176 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:12:08.677176 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:12:08.677176 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2db6cecf-c268-4ee6-a745-6e2130e594bb could not be found. Jun 25 16:12:08.677176 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:12:08.677176 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:12:08.677176 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:12:08.677176 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:12:08.677176 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:12:08.677176 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:12:08.677176 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:12:08.677176 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:12:08.677176 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:12:08.678368 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:12:08.678368 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 16:12:08.678368 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 16:12:08.678368 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:12:08.678368 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:12:08.678368 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:12:08.678368 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:12:08.678368 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2db6cecf-c268-4ee6-a745-6e2130e594bb could not be found. Jun 25 16:12:08.678368 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:12:08.678368 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:12:08.678368 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:12:08.678368 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:12:08.678368 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:12:08.678368 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:12:08.678368 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:12:08.678368 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:12:08.678368 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2db6cecf-c268-4ee6-a745-6e2130e594bb could not be found. Jun 25 16:12:08.678368 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:12:08.679396 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-2c9741cd-1cb4-4324-bae3-3f1f1133c1d4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Returning 404 to user: Instance 2db6cecf-c268-4ee6-a745-6e2130e594bb could not be found. {{(pid=117794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:12:08.679396 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-2c9741cd-1cb4-4324-bae3-3f1f1133c1d4 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb" status: 404 len: 111 microversion: 2.1 time: 0.031124 Jun 25 16:12:08.679396 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 338/679] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:12:08 2022] GET /compute/v2.1/servers/2db6cecf-c268-4ee6-a745-6e2130e594bb => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:12:09.819351 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-533b9b30-c1bf-4ca7-83e7-b9dc1e8bbfba tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:09.819865 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-533b9b30-c1bf-4ca7-83e7-b9dc1e8bbfba tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:09.826707 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-533b9b30-c1bf-4ca7-83e7-b9dc1e8bbfba tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:09.827246 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-533b9b30-c1bf-4ca7-83e7-b9dc1e8bbfba tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:09.828012 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-533b9b30-c1bf-4ca7-83e7-b9dc1e8bbfba tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:09.828441 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-533b9b30-c1bf-4ca7-83e7-b9dc1e8bbfba tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:09.843813 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-533b9b30-c1bf-4ca7-83e7-b9dc1e8bbfba tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] HTTP exception thrown: Instance b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 could not be found. Jun 25 16:12:09.845477 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-533b9b30-c1bf-4ca7-83e7-b9dc1e8bbfba tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Request method failure captured: Jun 25 16:12:09.845477 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: request: DELETE /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 HTTP/1.1 Jun 25 16:12:09.845477 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept: application/json Jun 25 16:12:09.845477 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jun 25 16:12:09.845477 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Connection: close Jun 25 16:12:09.845477 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jun 25 16:12:09.845477 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jun 25 16:12:09.845477 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Host: 10.222.0.13 Jun 25 16:12:09.845477 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jun 25 16:12:09.845477 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jun 25 16:12:09.845477 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABitzJ4VTX9FBO09dP9eDUNJ7kXDvOeQ_3800jobL_5yAtOgxQI54WUI0jlTKIeeP5rTVj0MTWBlkUxqhr419kWtC1O7I2ACk-hIdi2fMzwDg3khIX53lL7PAAWZJjGvTHF0eyDgeSSmpMCdU8rbC_7cLecxR6vp9KZlm3nwM3ZTo0XAYY Jun 25 16:12:09.845477 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jun 25 16:12:09.845477 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jun 25 16:12:09.845477 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jun 25 16:12:09.845477 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jun 25 16:12:09.845477 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jun 25 16:12:09.845477 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jun 25 16:12:09.845477 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Id: b1bba8f74dbd433bbffdb2ffbfc481fb Jun 25 16:12:09.845477 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:12:09.845477 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Role: reader,member Jun 25 16:12:09.845477 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Jun 25 16:12:09.847067 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b1bba8f74dbd433bbffdb2ffbfc481fb", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:12:09.847067 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:12:09.847067 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Id: b1bba8f74dbd433bbffdb2ffbfc481fb Jun 25 16:12:09.847067 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:12:09.847067 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeNegativeTest-1137598465-project Jun 25 16:12:09.847067 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jun 25 16:12:09.847067 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jun 25 16:12:09.847067 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Id: 19140330ae664e45b85f47f321496191 Jun 25 16:12:09.847067 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeNegativeTest-1137598465-project Jun 25 16:12:09.847067 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: method: > Jun 25 16:12:09.847067 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: exception: Instance b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 could not be found. Jun 25 16:12:09.847067 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: action_args: {'id': 'b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9'} Jun 25 16:12:09.847945 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:12:09.847945 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:12:09.847945 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:12:09.847945 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:12:09.847945 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:12:09.847945 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:12:09.847945 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:12:09.847945 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:12:09.847945 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:12:09.847945 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:12:09.847945 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 could not be found. Jun 25 16:12:09.847945 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:12:09.847945 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:12:09.847945 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:12:09.847945 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:12:09.847945 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:12:09.847945 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:12:09.847945 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:12:09.847945 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:12:09.847945 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:12:09.849359 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:12:09.849359 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 16:12:09.849359 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 16:12:09.849359 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 16:12:09.849359 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 16:12:09.849359 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:12:09.849359 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:12:09.849359 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:12:09.849359 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:12:09.849359 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 could not be found. Jun 25 16:12:09.849359 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:12:09.849359 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:12:09.849359 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:12:09.849359 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:12:09.849359 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:12:09.849359 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:12:09.849359 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:12:09.849359 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:12:09.849359 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 could not be found. Jun 25 16:12:09.849359 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:12:09.850730 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-533b9b30-c1bf-4ca7-83e7-b9dc1e8bbfba tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Returning 404 to user: Instance b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:12:09.850730 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-533b9b30-c1bf-4ca7-83e7-b9dc1e8bbfba tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9" status: 404 len: 111 microversion: 2.1 time: 0.031429 Jun 25 16:12:09.850730 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 342/680] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Jun 25 16:12:09 2022] DELETE /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:12:09.857262 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-13b2c374-defc-4197-b409-be250ad71d4c tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:09.857878 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-13b2c374-defc-4197-b409-be250ad71d4c tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:09.865746 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-13b2c374-defc-4197-b409-be250ad71d4c tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:09.866202 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-13b2c374-defc-4197-b409-be250ad71d4c tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:09.866983 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-13b2c374-defc-4197-b409-be250ad71d4c tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:09.867418 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-13b2c374-defc-4197-b409-be250ad71d4c tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:09.881458 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.wsgi [None req-13b2c374-defc-4197-b409-be250ad71d4c tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] HTTP exception thrown: Instance b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 could not be found. Jun 25 16:12:09.883018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-13b2c374-defc-4197-b409-be250ad71d4c tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Request method failure captured: Jun 25 16:12:09.883018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: request: GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 HTTP/1.1 Jun 25 16:12:09.883018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept: application/json Jun 25 16:12:09.883018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept-Encoding: identity Jun 25 16:12:09.883018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Connection: close Jun 25 16:12:09.883018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Length: 0 Jun 25 16:12:09.883018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Type: application/json Jun 25 16:12:09.883018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Host: 10.222.0.13 Jun 25 16:12:09.883018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Openstack-System-Scope: None Jun 25 16:12:09.883018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: User-Agent: python-urllib3/1.26.9 Jun 25 16:12:09.883018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Auth-Token: gAAAAABitzJ4VTX9FBO09dP9eDUNJ7kXDvOeQ_3800jobL_5yAtOgxQI54WUI0jlTKIeeP5rTVj0MTWBlkUxqhr419kWtC1O7I2ACk-hIdi2fMzwDg3khIX53lL7PAAWZJjGvTHF0eyDgeSSmpMCdU8rbC_7cLecxR6vp9KZlm3nwM3ZTo0XAYY Jun 25 16:12:09.883018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Id: None Jun 25 16:12:09.883018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Name: None Jun 25 16:12:09.883018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Identity-Status: Confirmed Jun 25 16:12:09.883018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Is-Admin-Project: True Jun 25 16:12:09.883018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Id: default Jun 25 16:12:09.883018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Name: Default Jun 25 16:12:09.883018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Id: b1bba8f74dbd433bbffdb2ffbfc481fb Jun 25 16:12:09.883018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Name: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:12:09.883018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Role: reader,member Jun 25 16:12:09.883018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Roles: reader,member Jun 25 16:12:09.884468 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b1bba8f74dbd433bbffdb2ffbfc481fb", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:12:09.884468 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:12:09.884468 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Id: b1bba8f74dbd433bbffdb2ffbfc481fb Jun 25 16:12:09.884468 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:12:09.884468 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User: tempest-AttachVolumeNegativeTest-1137598465-project Jun 25 16:12:09.884468 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Id: default Jun 25 16:12:09.884468 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Name: Default Jun 25 16:12:09.884468 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Id: 19140330ae664e45b85f47f321496191 Jun 25 16:12:09.884468 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Name: tempest-AttachVolumeNegativeTest-1137598465-project Jun 25 16:12:09.884468 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: method: > Jun 25 16:12:09.884468 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: exception: Instance b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 could not be found. Jun 25 16:12:09.884468 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: action_args: {'id': 'b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9'} Jun 25 16:12:09.885261 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:12:09.885261 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:12:09.885261 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:12:09.885261 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:12:09.885261 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:12:09.885261 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:12:09.885261 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:12:09.885261 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:12:09.885261 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:12:09.885261 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:12:09.885261 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 could not be found. Jun 25 16:12:09.885261 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:12:09.885261 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:12:09.885261 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:12:09.885261 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:12:09.885261 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:12:09.885261 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:12:09.885261 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:12:09.885261 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:12:09.885261 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:12:09.886808 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:12:09.886808 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 16:12:09.886808 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 16:12:09.886808 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:12:09.886808 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:12:09.886808 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:12:09.886808 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:12:09.886808 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 could not be found. Jun 25 16:12:09.886808 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:12:09.886808 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:12:09.886808 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:12:09.886808 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:12:09.886808 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:12:09.886808 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:12:09.886808 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:12:09.886808 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:12:09.886808 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 could not be found. Jun 25 16:12:09.886808 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:12:09.888083 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-13b2c374-defc-4197-b409-be250ad71d4c tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Returning 404 to user: Instance b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 could not be found. {{(pid=117794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:12:09.888083 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-13b2c374-defc-4197-b409-be250ad71d4c tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9" status: 404 len: 111 microversion: 2.1 time: 0.032655 Jun 25 16:12:09.888083 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 339/681] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:12:09 2022] GET /compute/v2.1/servers/b91b0dfb-0cf0-4bf0-8e9c-c7991fe6c3b9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:12:09.894675 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-61761635-e7e1-4488-9f26-c7221925f6fe tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:09.895194 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-61761635-e7e1-4488-9f26-c7221925f6fe tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 0d92f23b-4b14-4619-a2c9-a90bd96b27fd] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:09.901340 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-61761635-e7e1-4488-9f26-c7221925f6fe tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:09.901783 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-61761635-e7e1-4488-9f26-c7221925f6fe tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:09.902531 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-61761635-e7e1-4488-9f26-c7221925f6fe tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:09.902958 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-61761635-e7e1-4488-9f26-c7221925f6fe tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:09.916706 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-61761635-e7e1-4488-9f26-c7221925f6fe tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] HTTP exception thrown: Instance 0d92f23b-4b14-4619-a2c9-a90bd96b27fd could not be found. Jun 25 16:12:09.918246 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-61761635-e7e1-4488-9f26-c7221925f6fe tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Request method failure captured: Jun 25 16:12:09.918246 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: request: DELETE /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd HTTP/1.1 Jun 25 16:12:09.918246 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept: application/json Jun 25 16:12:09.918246 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jun 25 16:12:09.918246 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Connection: close Jun 25 16:12:09.918246 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jun 25 16:12:09.918246 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jun 25 16:12:09.918246 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Host: 10.222.0.13 Jun 25 16:12:09.918246 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jun 25 16:12:09.918246 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jun 25 16:12:09.918246 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABitzJ4VTX9FBO09dP9eDUNJ7kXDvOeQ_3800jobL_5yAtOgxQI54WUI0jlTKIeeP5rTVj0MTWBlkUxqhr419kWtC1O7I2ACk-hIdi2fMzwDg3khIX53lL7PAAWZJjGvTHF0eyDgeSSmpMCdU8rbC_7cLecxR6vp9KZlm3nwM3ZTo0XAYY Jun 25 16:12:09.918246 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jun 25 16:12:09.918246 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jun 25 16:12:09.918246 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jun 25 16:12:09.918246 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jun 25 16:12:09.918246 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jun 25 16:12:09.918246 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jun 25 16:12:09.918246 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Id: b1bba8f74dbd433bbffdb2ffbfc481fb Jun 25 16:12:09.918246 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:12:09.918246 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Role: reader,member Jun 25 16:12:09.918246 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Jun 25 16:12:09.919768 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b1bba8f74dbd433bbffdb2ffbfc481fb", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:12:09.919768 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:12:09.919768 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Id: b1bba8f74dbd433bbffdb2ffbfc481fb Jun 25 16:12:09.919768 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:12:09.919768 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeNegativeTest-1137598465-project Jun 25 16:12:09.919768 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jun 25 16:12:09.919768 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jun 25 16:12:09.919768 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Id: 19140330ae664e45b85f47f321496191 Jun 25 16:12:09.919768 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeNegativeTest-1137598465-project Jun 25 16:12:09.919768 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: method: > Jun 25 16:12:09.919768 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: exception: Instance 0d92f23b-4b14-4619-a2c9-a90bd96b27fd could not be found. Jun 25 16:12:09.919768 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: action_args: {'id': '0d92f23b-4b14-4619-a2c9-a90bd96b27fd'} Jun 25 16:12:09.921084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:12:09.921084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:12:09.921084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:12:09.921084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:12:09.921084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:12:09.921084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:12:09.921084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:12:09.921084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:12:09.921084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:12:09.921084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:12:09.921084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d92f23b-4b14-4619-a2c9-a90bd96b27fd could not be found. Jun 25 16:12:09.921084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:12:09.921084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:12:09.921084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:12:09.921084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:12:09.921084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:12:09.921084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:12:09.921084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:12:09.921084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:12:09.921084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:12:09.922613 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:12:09.922613 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 16:12:09.922613 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 16:12:09.922613 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 16:12:09.922613 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 16:12:09.922613 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:12:09.922613 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:12:09.922613 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:12:09.922613 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:12:09.922613 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d92f23b-4b14-4619-a2c9-a90bd96b27fd could not be found. Jun 25 16:12:09.922613 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:12:09.922613 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:12:09.922613 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:12:09.922613 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:12:09.922613 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:12:09.922613 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:12:09.922613 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:12:09.922613 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:12:09.922613 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d92f23b-4b14-4619-a2c9-a90bd96b27fd could not be found. Jun 25 16:12:09.922613 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:12:09.924123 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-61761635-e7e1-4488-9f26-c7221925f6fe tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Returning 404 to user: Instance 0d92f23b-4b14-4619-a2c9-a90bd96b27fd could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:12:09.924123 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-61761635-e7e1-4488-9f26-c7221925f6fe tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd" status: 404 len: 111 microversion: 2.1 time: 0.029918 Jun 25 16:12:09.924123 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 343/682] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Jun 25 16:12:09 2022] DELETE /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:12:09.928231 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-d3f2a108-d7ad-420e-9dcc-7d3434c77cf8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:09.928888 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-d3f2a108-d7ad-420e-9dcc-7d3434c77cf8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 0d92f23b-4b14-4619-a2c9-a90bd96b27fd] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:09.935006 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d3f2a108-d7ad-420e-9dcc-7d3434c77cf8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:09.935463 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d3f2a108-d7ad-420e-9dcc-7d3434c77cf8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:09.936224 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d3f2a108-d7ad-420e-9dcc-7d3434c77cf8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:09.936741 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d3f2a108-d7ad-420e-9dcc-7d3434c77cf8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:09.950338 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.wsgi [None req-d3f2a108-d7ad-420e-9dcc-7d3434c77cf8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] HTTP exception thrown: Instance 0d92f23b-4b14-4619-a2c9-a90bd96b27fd could not be found. Jun 25 16:12:09.952287 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-d3f2a108-d7ad-420e-9dcc-7d3434c77cf8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Request method failure captured: Jun 25 16:12:09.952287 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: request: GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd HTTP/1.1 Jun 25 16:12:09.952287 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept: application/json Jun 25 16:12:09.952287 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept-Encoding: identity Jun 25 16:12:09.952287 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Connection: close Jun 25 16:12:09.952287 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Length: 0 Jun 25 16:12:09.952287 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Type: application/json Jun 25 16:12:09.952287 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Host: 10.222.0.13 Jun 25 16:12:09.952287 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Openstack-System-Scope: None Jun 25 16:12:09.952287 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: User-Agent: python-urllib3/1.26.9 Jun 25 16:12:09.952287 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Auth-Token: gAAAAABitzJ4VTX9FBO09dP9eDUNJ7kXDvOeQ_3800jobL_5yAtOgxQI54WUI0jlTKIeeP5rTVj0MTWBlkUxqhr419kWtC1O7I2ACk-hIdi2fMzwDg3khIX53lL7PAAWZJjGvTHF0eyDgeSSmpMCdU8rbC_7cLecxR6vp9KZlm3nwM3ZTo0XAYY Jun 25 16:12:09.952287 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Id: None Jun 25 16:12:09.952287 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Name: None Jun 25 16:12:09.952287 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Identity-Status: Confirmed Jun 25 16:12:09.952287 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Is-Admin-Project: True Jun 25 16:12:09.952287 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Id: default Jun 25 16:12:09.952287 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Name: Default Jun 25 16:12:09.952287 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Id: b1bba8f74dbd433bbffdb2ffbfc481fb Jun 25 16:12:09.952287 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Name: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:12:09.952287 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Role: reader,member Jun 25 16:12:09.952287 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Roles: reader,member Jun 25 16:12:09.954017 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b1bba8f74dbd433bbffdb2ffbfc481fb", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:12:09.954017 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:12:09.954017 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Id: b1bba8f74dbd433bbffdb2ffbfc481fb Jun 25 16:12:09.954017 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:12:09.954017 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User: tempest-AttachVolumeNegativeTest-1137598465-project Jun 25 16:12:09.954017 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Id: default Jun 25 16:12:09.954017 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Name: Default Jun 25 16:12:09.954017 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Id: 19140330ae664e45b85f47f321496191 Jun 25 16:12:09.954017 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Name: tempest-AttachVolumeNegativeTest-1137598465-project Jun 25 16:12:09.954017 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: method: > Jun 25 16:12:09.954017 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: exception: Instance 0d92f23b-4b14-4619-a2c9-a90bd96b27fd could not be found. Jun 25 16:12:09.954017 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: action_args: {'id': '0d92f23b-4b14-4619-a2c9-a90bd96b27fd'} Jun 25 16:12:09.954828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:12:09.954828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:12:09.954828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:12:09.954828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:12:09.954828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:12:09.954828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:12:09.954828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:12:09.954828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:12:09.954828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:12:09.954828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:12:09.954828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d92f23b-4b14-4619-a2c9-a90bd96b27fd could not be found. Jun 25 16:12:09.954828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:12:09.954828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:12:09.954828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:12:09.954828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:12:09.954828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:12:09.954828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:12:09.954828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:12:09.954828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:12:09.954828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:12:09.956421 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:12:09.956421 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 16:12:09.956421 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 16:12:09.956421 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:12:09.956421 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:12:09.956421 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:12:09.956421 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:12:09.956421 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d92f23b-4b14-4619-a2c9-a90bd96b27fd could not be found. Jun 25 16:12:09.956421 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:12:09.956421 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:12:09.956421 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:12:09.956421 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:12:09.956421 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:12:09.956421 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:12:09.956421 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:12:09.956421 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:12:09.956421 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d92f23b-4b14-4619-a2c9-a90bd96b27fd could not be found. Jun 25 16:12:09.956421 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:12:09.957667 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-d3f2a108-d7ad-420e-9dcc-7d3434c77cf8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Returning 404 to user: Instance 0d92f23b-4b14-4619-a2c9-a90bd96b27fd could not be found. {{(pid=117794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:12:09.957667 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-d3f2a108-d7ad-420e-9dcc-7d3434c77cf8 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd" status: 404 len: 111 microversion: 2.1 time: 0.029454 Jun 25 16:12:09.957667 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 340/683] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:12:09 2022] GET /compute/v2.1/servers/0d92f23b-4b14-4619-a2c9-a90bd96b27fd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 25 16:12:11.088589 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-43fb1fd0-c132-4e45-a893-caf9743d82d3 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:11.089152 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-43fb1fd0-c132-4e45-a893-caf9743d82d3 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:11.091521 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:12:11.097484 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-43fb1fd0-c132-4e45-a893-caf9743d82d3 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:11.097929 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-43fb1fd0-c132-4e45-a893-caf9743d82d3 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:11.098695 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-43fb1fd0-c132-4e45-a893-caf9743d82d3 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:11.099123 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-43fb1fd0-c132-4e45-a893-caf9743d82d3 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:11.114165 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-43fb1fd0-c132-4e45-a893-caf9743d82d3 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] HTTP exception thrown: Instance 9dc4f0bb-0b30-429c-af92-a30f31e4b60f could not be found. Jun 25 16:12:11.115634 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-43fb1fd0-c132-4e45-a893-caf9743d82d3 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Request method failure captured: Jun 25 16:12:11.115634 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: request: DELETE /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f HTTP/1.1 Jun 25 16:12:11.115634 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept: application/json Jun 25 16:12:11.115634 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jun 25 16:12:11.115634 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Connection: close Jun 25 16:12:11.115634 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jun 25 16:12:11.115634 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jun 25 16:12:11.115634 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Host: 10.222.0.13 Jun 25 16:12:11.115634 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jun 25 16:12:11.115634 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jun 25 16:12:11.115634 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABitzJ4VTX9FBO09dP9eDUNJ7kXDvOeQ_3800jobL_5yAtOgxQI54WUI0jlTKIeeP5rTVj0MTWBlkUxqhr419kWtC1O7I2ACk-hIdi2fMzwDg3khIX53lL7PAAWZJjGvTHF0eyDgeSSmpMCdU8rbC_7cLecxR6vp9KZlm3nwM3ZTo0XAYY Jun 25 16:12:11.115634 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jun 25 16:12:11.115634 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jun 25 16:12:11.115634 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jun 25 16:12:11.115634 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jun 25 16:12:11.115634 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jun 25 16:12:11.115634 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jun 25 16:12:11.115634 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Id: b1bba8f74dbd433bbffdb2ffbfc481fb Jun 25 16:12:11.115634 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:12:11.115634 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Role: reader,member Jun 25 16:12:11.115634 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Jun 25 16:12:11.117220 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b1bba8f74dbd433bbffdb2ffbfc481fb", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:12:11.117220 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:12:11.117220 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Id: b1bba8f74dbd433bbffdb2ffbfc481fb Jun 25 16:12:11.117220 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:12:11.117220 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeNegativeTest-1137598465-project Jun 25 16:12:11.117220 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jun 25 16:12:11.117220 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jun 25 16:12:11.117220 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Id: 19140330ae664e45b85f47f321496191 Jun 25 16:12:11.117220 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeNegativeTest-1137598465-project Jun 25 16:12:11.117220 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: method: > Jun 25 16:12:11.117220 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: exception: Instance 9dc4f0bb-0b30-429c-af92-a30f31e4b60f could not be found. Jun 25 16:12:11.117220 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: action_args: {'id': '9dc4f0bb-0b30-429c-af92-a30f31e4b60f'} Jun 25 16:12:11.118003 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:12:11.118003 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:12:11.118003 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:12:11.118003 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:12:11.118003 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:12:11.118003 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:12:11.118003 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:12:11.118003 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:12:11.118003 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:12:11.118003 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:12:11.118003 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dc4f0bb-0b30-429c-af92-a30f31e4b60f could not be found. Jun 25 16:12:11.118003 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:12:11.118003 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:12:11.118003 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:12:11.118003 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:12:11.118003 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:12:11.118003 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:12:11.118003 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:12:11.118003 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:12:11.118003 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:12:11.119252 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:12:11.119252 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 16:12:11.119252 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 16:12:11.119252 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 16:12:11.119252 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 16:12:11.119252 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:12:11.119252 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:12:11.119252 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:12:11.119252 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:12:11.119252 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dc4f0bb-0b30-429c-af92-a30f31e4b60f could not be found. Jun 25 16:12:11.119252 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:12:11.119252 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:12:11.119252 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:12:11.119252 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:12:11.119252 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:12:11.119252 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:12:11.119252 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:12:11.119252 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:12:11.119252 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dc4f0bb-0b30-429c-af92-a30f31e4b60f could not be found. Jun 25 16:12:11.119252 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:12:11.120676 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-43fb1fd0-c132-4e45-a893-caf9743d82d3 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Returning 404 to user: Instance 9dc4f0bb-0b30-429c-af92-a30f31e4b60f could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:12:11.120676 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-43fb1fd0-c132-4e45-a893-caf9743d82d3 tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 404 len: 111 microversion: 2.1 time: 0.032337 Jun 25 16:12:11.120676 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 344/684] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Jun 25 16:12:11 2022] DELETE /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:12:11.126621 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-8bf73aa1-3141-4183-9c63-b9a9d3d20c4a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:11.127290 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-8bf73aa1-3141-4183-9c63-b9a9d3d20c4a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] [instance: 9dc4f0bb-0b30-429c-af92-a30f31e4b60f] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:11.134277 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8bf73aa1-3141-4183-9c63-b9a9d3d20c4a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:11.134722 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8bf73aa1-3141-4183-9c63-b9a9d3d20c4a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:11.135482 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8bf73aa1-3141-4183-9c63-b9a9d3d20c4a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:11.135908 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8bf73aa1-3141-4183-9c63-b9a9d3d20c4a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:11.149793 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.wsgi [None req-8bf73aa1-3141-4183-9c63-b9a9d3d20c4a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] HTTP exception thrown: Instance 9dc4f0bb-0b30-429c-af92-a30f31e4b60f could not be found. Jun 25 16:12:11.151308 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-8bf73aa1-3141-4183-9c63-b9a9d3d20c4a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Request method failure captured: Jun 25 16:12:11.151308 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: request: GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f HTTP/1.1 Jun 25 16:12:11.151308 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept: application/json Jun 25 16:12:11.151308 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept-Encoding: identity Jun 25 16:12:11.151308 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Connection: close Jun 25 16:12:11.151308 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Length: 0 Jun 25 16:12:11.151308 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Type: application/json Jun 25 16:12:11.151308 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Host: 10.222.0.13 Jun 25 16:12:11.151308 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Openstack-System-Scope: None Jun 25 16:12:11.151308 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: User-Agent: python-urllib3/1.26.9 Jun 25 16:12:11.151308 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Auth-Token: gAAAAABitzJ4VTX9FBO09dP9eDUNJ7kXDvOeQ_3800jobL_5yAtOgxQI54WUI0jlTKIeeP5rTVj0MTWBlkUxqhr419kWtC1O7I2ACk-hIdi2fMzwDg3khIX53lL7PAAWZJjGvTHF0eyDgeSSmpMCdU8rbC_7cLecxR6vp9KZlm3nwM3ZTo0XAYY Jun 25 16:12:11.151308 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Id: None Jun 25 16:12:11.151308 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Name: None Jun 25 16:12:11.151308 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Identity-Status: Confirmed Jun 25 16:12:11.151308 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Is-Admin-Project: True Jun 25 16:12:11.151308 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Id: default Jun 25 16:12:11.151308 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Name: Default Jun 25 16:12:11.151308 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Id: b1bba8f74dbd433bbffdb2ffbfc481fb Jun 25 16:12:11.151308 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Name: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:12:11.151308 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Role: reader,member Jun 25 16:12:11.151308 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Roles: reader,member Jun 25 16:12:11.152753 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b1bba8f74dbd433bbffdb2ffbfc481fb", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b1bba8f74dbd433bbffdb2ffbfc481fb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:12:11.152753 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:12:11.152753 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Id: b1bba8f74dbd433bbffdb2ffbfc481fb Jun 25 16:12:11.152753 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1137598465 Jun 25 16:12:11.152753 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User: tempest-AttachVolumeNegativeTest-1137598465-project Jun 25 16:12:11.152753 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Id: default Jun 25 16:12:11.152753 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Name: Default Jun 25 16:12:11.152753 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Id: 19140330ae664e45b85f47f321496191 Jun 25 16:12:11.152753 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Name: tempest-AttachVolumeNegativeTest-1137598465-project Jun 25 16:12:11.152753 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: method: > Jun 25 16:12:11.152753 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: exception: Instance 9dc4f0bb-0b30-429c-af92-a30f31e4b60f could not be found. Jun 25 16:12:11.152753 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: action_args: {'id': '9dc4f0bb-0b30-429c-af92-a30f31e4b60f'} Jun 25 16:12:11.153449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:12:11.153449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:12:11.153449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:12:11.153449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:12:11.153449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:12:11.153449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:12:11.153449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:12:11.153449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:12:11.153449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:12:11.153449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:12:11.153449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dc4f0bb-0b30-429c-af92-a30f31e4b60f could not be found. Jun 25 16:12:11.153449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:12:11.153449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:12:11.153449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:12:11.153449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:12:11.153449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:12:11.153449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:12:11.153449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:12:11.153449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:12:11.153449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:12:11.154689 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:12:11.154689 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 16:12:11.154689 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 16:12:11.154689 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:12:11.154689 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:12:11.154689 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:12:11.154689 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:12:11.154689 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dc4f0bb-0b30-429c-af92-a30f31e4b60f could not be found. Jun 25 16:12:11.154689 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:12:11.154689 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:12:11.154689 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:12:11.154689 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:12:11.154689 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:12:11.154689 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:12:11.154689 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:12:11.154689 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:12:11.154689 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dc4f0bb-0b30-429c-af92-a30f31e4b60f could not be found. Jun 25 16:12:11.154689 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:12:11.156188 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-8bf73aa1-3141-4183-9c63-b9a9d3d20c4a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] Returning 404 to user: Instance 9dc4f0bb-0b30-429c-af92-a30f31e4b60f could not be found. {{(pid=117794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:12:11.156188 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-8bf73aa1-3141-4183-9c63-b9a9d3d20c4a tempest-AttachVolumeNegativeTest-1137598465 tempest-AttachVolumeNegativeTest-1137598465-project] 10.222.0.13 "GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f" status: 404 len: 111 microversion: 2.1 time: 0.030937 Jun 25 16:12:11.156188 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 341/685] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:12:11 2022] GET /compute/v2.1/servers/9dc4f0bb-0b30-429c-af92-a30f31e4b60f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:12:15.755171 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-693fa314-4588-4211-84b4-09877726499c tempest-VolumesGetTestJSON-147576287 tempest-VolumesGetTestJSON-147576287-project] Action: 'create', calling method: .version_select at 0x7f65bb5924c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1690667926", "metadata": {"Type": "work"}}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:12:16.072021 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-693fa314-4588-4211-84b4-09877726499c tempest-VolumesGetTestJSON-147576287 tempest-VolumesGetTestJSON-147576287-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.439942 Jun 25 16:12:16.075145 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 345/686] 10.222.0.13 () {60 vars in 1155 bytes} [Sat Jun 25 16:12:15 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 442 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 25 16:12:16.084777 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-eddb8991-2677-459e-87f9-40045e00e0a8 tempest-VolumesGetTestJSON-147576287 tempest-VolumesGetTestJSON-147576287-project] Calling method '.version_select at 0x7f65bb5944c0>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:16.135132 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-eddb8991-2677-459e-87f9-40045e00e0a8 tempest-VolumesGetTestJSON-147576287 tempest-VolumesGetTestJSON-147576287-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8adb12ef-1547-4ddd-b7a7-be7d6807d88f" status: 200 len: 353 microversion: 2.1 time: 0.054701 Jun 25 16:12:16.135737 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 342/687] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Jun 25 16:12:16 2022] GET /compute/v2.1/os-volumes/8adb12ef-1547-4ddd-b7a7-be7d6807d88f => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:12:16.480124 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8f7ae470-4a3f-4541-a79b-628f4addb36b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:16.480881 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8f7ae470-4a3f-4541-a79b-628f4addb36b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:16.488758 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f7ae470-4a3f-4541-a79b-628f4addb36b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:16.489206 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f7ae470-4a3f-4541-a79b-628f4addb36b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:16.489959 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f7ae470-4a3f-4541-a79b-628f4addb36b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:16.490392 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8f7ae470-4a3f-4541-a79b-628f4addb36b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:16.514132 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8f7ae470-4a3f-4541-a79b-628f4addb36b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe/ips" status: 200 len: 152 microversion: 2.20 time: 0.039886 Jun 25 16:12:16.515298 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 346/688] 10.222.0.13 () {60 vars in 1288 bytes} [Sat Jun 25 16:12:16 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 25 16:12:17.149441 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-829a0852-fa1f-46d5-b249-f5390cc655db tempest-VolumesGetTestJSON-147576287 tempest-VolumesGetTestJSON-147576287-project] Calling method '.version_select at 0x7f65bb571c10>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:17.200887 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-829a0852-fa1f-46d5-b249-f5390cc655db tempest-VolumesGetTestJSON-147576287 tempest-VolumesGetTestJSON-147576287-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8adb12ef-1547-4ddd-b7a7-be7d6807d88f" status: 200 len: 354 microversion: 2.1 time: 0.055864 Jun 25 16:12:17.201496 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 343/689] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Jun 25 16:12:17 2022] GET /compute/v2.1/os-volumes/8adb12ef-1547-4ddd-b7a7-be7d6807d88f => generated 354 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:12:17.212877 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-536026ea-9a64-44ac-806c-fbf1231598e3 tempest-VolumesGetTestJSON-147576287 tempest-VolumesGetTestJSON-147576287-project] Calling method '.version_select at 0x7f65bb64e790>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:17.267161 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-536026ea-9a64-44ac-806c-fbf1231598e3 tempest-VolumesGetTestJSON-147576287 tempest-VolumesGetTestJSON-147576287-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8adb12ef-1547-4ddd-b7a7-be7d6807d88f" status: 200 len: 354 microversion: 2.1 time: 0.058072 Jun 25 16:12:17.267714 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 347/690] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Jun 25 16:12:17 2022] GET /compute/v2.1/os-volumes/8adb12ef-1547-4ddd-b7a7-be7d6807d88f => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:12:17.279590 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-33ae1938-1847-4291-b2a4-42e7ba8d6462 tempest-VolumesGetTestJSON-147576287 tempest-VolumesGetTestJSON-147576287-project] Calling method '.version_select at 0x7f65bb5719d0>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:17.350946 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-33ae1938-1847-4291-b2a4-42e7ba8d6462 tempest-VolumesGetTestJSON-147576287 tempest-VolumesGetTestJSON-147576287-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/8adb12ef-1547-4ddd-b7a7-be7d6807d88f" status: 202 len: 0 microversion: 2.1 time: 0.075296 Jun 25 16:12:17.351551 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 344/691] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Jun 25 16:12:17 2022] DELETE /compute/v2.1/os-volumes/8adb12ef-1547-4ddd-b7a7-be7d6807d88f => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 16:12:17.361365 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-186a7886-33bd-4473-9bc9-873a4d29c6ac tempest-VolumesGetTestJSON-147576287 tempest-VolumesGetTestJSON-147576287-project] Calling method '.version_select at 0x7f65bb592160>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:17.411523 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-186a7886-33bd-4473-9bc9-873a4d29c6ac tempest-VolumesGetTestJSON-147576287 tempest-VolumesGetTestJSON-147576287-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8adb12ef-1547-4ddd-b7a7-be7d6807d88f" status: 200 len: 353 microversion: 2.1 time: 0.054381 Jun 25 16:12:17.412107 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 348/692] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Jun 25 16:12:17 2022] GET /compute/v2.1/os-volumes/8adb12ef-1547-4ddd-b7a7-be7d6807d88f => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:12:18.425372 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-c42cf66c-bdc9-4841-b37f-730ef66614bb tempest-VolumesGetTestJSON-147576287 tempest-VolumesGetTestJSON-147576287-project] Calling method '.version_select at 0x7f65bb56b5e0>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:18.456855 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.wsgi [None req-c42cf66c-bdc9-4841-b37f-730ef66614bb tempest-VolumesGetTestJSON-147576287 tempest-VolumesGetTestJSON-147576287-project] HTTP exception thrown: Volume 8adb12ef-1547-4ddd-b7a7-be7d6807d88f could not be found. Jun 25 16:12:18.459626 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-c42cf66c-bdc9-4841-b37f-730ef66614bb tempest-VolumesGetTestJSON-147576287 tempest-VolumesGetTestJSON-147576287-project] Request method failure captured: Jun 25 16:12:18.459626 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: request: GET /compute/v2.1/os-volumes/8adb12ef-1547-4ddd-b7a7-be7d6807d88f HTTP/1.1 Jun 25 16:12:18.459626 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept: application/json Jun 25 16:12:18.459626 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept-Encoding: identity Jun 25 16:12:18.459626 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Connection: close Jun 25 16:12:18.459626 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Length: 0 Jun 25 16:12:18.459626 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Type: application/json Jun 25 16:12:18.459626 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Host: 10.222.0.13 Jun 25 16:12:18.459626 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Openstack-System-Scope: None Jun 25 16:12:18.459626 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: User-Agent: python-urllib3/1.26.9 Jun 25 16:12:18.459626 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Auth-Token: gAAAAABitzPfciCd8Qq82j1rrNHgS-2vwGopUhvIEKCeD97Eauemz_cFWUN5Hn_UQk0YOZDbgjaNY-F4MGefR8UgIzeMDsgT7xBnTPs_I-YRC1TcuwkU80ZiZaSa8eSDCM0e0fsLO1dCVOrBPRZoVVuDU4M2gB8MGv9Ida6GSEaKhhgNEWTvdbA Jun 25 16:12:18.459626 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Id: None Jun 25 16:12:18.459626 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Name: None Jun 25 16:12:18.459626 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Identity-Status: Confirmed Jun 25 16:12:18.459626 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Is-Admin-Project: True Jun 25 16:12:18.459626 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Id: default Jun 25 16:12:18.459626 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Name: Default Jun 25 16:12:18.459626 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Id: 9d2980c65c0a4157ae8f9a022a9f5eca Jun 25 16:12:18.459626 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Name: tempest-VolumesGetTestJSON-147576287 Jun 25 16:12:18.459626 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Role: reader,member Jun 25 16:12:18.459626 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Roles: reader,member Jun 25 16:12:18.461170 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9d2980c65c0a4157ae8f9a022a9f5eca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9d2980c65c0a4157ae8f9a022a9f5eca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9d2980c65c0a4157ae8f9a022a9f5eca", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9d2980c65c0a4157ae8f9a022a9f5eca"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:12:18.461170 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant: tempest-VolumesGetTestJSON-147576287 Jun 25 16:12:18.461170 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Id: 9d2980c65c0a4157ae8f9a022a9f5eca Jun 25 16:12:18.461170 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Name: tempest-VolumesGetTestJSON-147576287 Jun 25 16:12:18.461170 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User: tempest-VolumesGetTestJSON-147576287-project Jun 25 16:12:18.461170 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Id: default Jun 25 16:12:18.461170 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Name: Default Jun 25 16:12:18.461170 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Id: 76801fe174ac42b6aa7ec0661cd6159d Jun 25 16:12:18.461170 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Name: tempest-VolumesGetTestJSON-147576287-project Jun 25 16:12:18.461170 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: method: Jun 25 16:12:18.461170 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: exception: Volume 8adb12ef-1547-4ddd-b7a7-be7d6807d88f could not be found. Jun 25 16:12:18.461170 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: action_args: {'id': '8adb12ef-1547-4ddd-b7a7-be7d6807d88f'} Jun 25 16:12:18.461170 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:12:18.462167 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:12:18.462167 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 25 16:12:18.462167 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 25 16:12:18.462167 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 25 16:12:18.462167 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 25 16:12:18.462167 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 25 16:12:18.462167 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 25 16:12:18.462167 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 25 16:12:18.462167 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 25 16:12:18.462167 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 25 16:12:18.462167 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 25 16:12:18.462167 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 16:12:18.462167 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 16:12:18.462167 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 16:12:18.462167 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 16:12:18.462167 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8adb12ef-1547-4ddd-b7a7-be7d6807d88f could not be found. (HTTP 404) (Request-ID: req-eb8db8cf-cb46-409c-afc7-6071323ba53d) Jun 25 16:12:18.462167 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:12:18.462167 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:12:18.462167 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:12:18.463581 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:12:18.463581 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 25 16:12:18.463581 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 25 16:12:18.463581 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 25 16:12:18.463581 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 25 16:12:18.463581 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 25 16:12:18.463581 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 25 16:12:18.463581 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 25 16:12:18.463581 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 25 16:12:18.463581 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 25 16:12:18.463581 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 25 16:12:18.463581 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 25 16:12:18.463581 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 25 16:12:18.463581 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 25 16:12:18.463581 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 25 16:12:18.463581 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 25 16:12:18.463581 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 25 16:12:18.463581 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 25 16:12:18.463581 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 25 16:12:18.465077 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 16:12:18.465077 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 16:12:18.465077 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 16:12:18.465077 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 16:12:18.465077 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8adb12ef-1547-4ddd-b7a7-be7d6807d88f could not be found. Jun 25 16:12:18.465077 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:12:18.465077 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:12:18.465077 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:12:18.465077 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:12:18.465077 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:12:18.465077 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:12:18.465077 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:12:18.465077 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:12:18.465077 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 16:12:18.465077 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 16:12:18.465077 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:12:18.465077 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:12:18.465077 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 25 16:12:18.465077 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:12:18.466359 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8adb12ef-1547-4ddd-b7a7-be7d6807d88f could not be found. Jun 25 16:12:18.466359 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:12:18.466359 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:12:18.466359 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:12:18.466359 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:12:18.466359 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:12:18.466359 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:12:18.466359 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:12:18.466359 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:12:18.466359 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8adb12ef-1547-4ddd-b7a7-be7d6807d88f could not be found. Jun 25 16:12:18.466359 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:12:18.466359 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-c42cf66c-bdc9-4841-b37f-730ef66614bb tempest-VolumesGetTestJSON-147576287 tempest-VolumesGetTestJSON-147576287-project] Returning 404 to user: Volume 8adb12ef-1547-4ddd-b7a7-be7d6807d88f could not be found. {{(pid=117794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:12:18.466359 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-c42cf66c-bdc9-4841-b37f-730ef66614bb tempest-VolumesGetTestJSON-147576287 tempest-VolumesGetTestJSON-147576287-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8adb12ef-1547-4ddd-b7a7-be7d6807d88f" status: 404 len: 109 microversion: 2.1 time: 0.040699 Jun 25 16:12:18.466359 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 345/693] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Jun 25 16:12:18 2022] GET /compute/v2.1/os-volumes/8adb12ef-1547-4ddd-b7a7-be7d6807d88f => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:12:19.014071 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a313284b-9f5f-4134-bdc5-698dd29e0d82 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:12:19.015571 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a313284b-9f5f-4134-bdc5-698dd29e0d82 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:19.022580 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a313284b-9f5f-4134-bdc5-698dd29e0d82 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:19.023034 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a313284b-9f5f-4134-bdc5-698dd29e0d82 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:19.023806 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a313284b-9f5f-4134-bdc5-698dd29e0d82 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:19.024260 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a313284b-9f5f-4134-bdc5-698dd29e0d82 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:19.054044 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-a313284b-9f5f-4134-bdc5-698dd29e0d82 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lazy-loading 'flavor' on Instance uuid 749fc9b1-a969-425d-b2e4-a88b63a45ffe {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 16:12:19.316226 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a313284b-9f5f-4134-bdc5-698dd29e0d82 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "POST /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe/action" status: 202 len: 0 microversion: 2.20 time: 0.306357 Jun 25 16:12:19.317268 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 349/694] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Jun 25 16:12:19 2022] POST /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 25 16:12:19.325336 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-52773f35-d072-4beb-99cd-2e9a94e0128c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:19.326086 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-52773f35-d072-4beb-99cd-2e9a94e0128c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:19.342192 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-52773f35-d072-4beb-99cd-2e9a94e0128c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:19.342940 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-52773f35-d072-4beb-99cd-2e9a94e0128c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:19.344437 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-52773f35-d072-4beb-99cd-2e9a94e0128c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:19.345099 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-52773f35-d072-4beb-99cd-2e9a94e0128c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:19.488254 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-52773f35-d072-4beb-99cd-2e9a94e0128c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:19.496467 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-52773f35-d072-4beb-99cd-2e9a94e0128c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:19.497943 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-52773f35-d072-4beb-99cd-2e9a94e0128c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:19.499791 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-52773f35-d072-4beb-99cd-2e9a94e0128c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1724 microversion: 2.20 time: 0.177949 Jun 25 16:12:19.500625 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 346/695] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:12:19 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:12:20.520276 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-70e3856e-5e3b-4096-9cb7-f9abfac09766 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:20.520962 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-70e3856e-5e3b-4096-9cb7-f9abfac09766 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:20.527691 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-70e3856e-5e3b-4096-9cb7-f9abfac09766 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:20.528130 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-70e3856e-5e3b-4096-9cb7-f9abfac09766 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:20.528932 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-70e3856e-5e3b-4096-9cb7-f9abfac09766 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:20.529349 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-70e3856e-5e3b-4096-9cb7-f9abfac09766 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:20.668881 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-70e3856e-5e3b-4096-9cb7-f9abfac09766 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:20.680986 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-70e3856e-5e3b-4096-9cb7-f9abfac09766 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:20.683455 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-70e3856e-5e3b-4096-9cb7-f9abfac09766 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:20.685304 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-70e3856e-5e3b-4096-9cb7-f9abfac09766 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1724 microversion: 2.20 time: 0.169793 Jun 25 16:12:20.686233 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 350/696] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:12:20 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:12:21.277801 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-656b909b-4303-453f-87a3-ecbd4ad89d1e tempest-VolumesTestJSON-1132187115 tempest-VolumesTestJSON-1132187115-project] Calling method '.version_select at 0x7f65bb56ba60>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:21.332770 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-656b909b-4303-453f-87a3-ecbd4ad89d1e tempest-VolumesTestJSON-1132187115 tempest-VolumesTestJSON-1132187115-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/f699bc09-7ba4-427c-9dda-13b379d35321" status: 200 len: 350 microversion: 2.1 time: 0.058859 Jun 25 16:12:21.333328 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 347/697] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Jun 25 16:12:21 2022] GET /compute/v2.1/os-volumes/f699bc09-7ba4-427c-9dda-13b379d35321 => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:12:21.711699 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d7b4398c-98b7-47ea-9663-35e8fa4c09ca tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:21.712365 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d7b4398c-98b7-47ea-9663-35e8fa4c09ca tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:21.719161 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d7b4398c-98b7-47ea-9663-35e8fa4c09ca tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:21.719617 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d7b4398c-98b7-47ea-9663-35e8fa4c09ca tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:21.720385 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d7b4398c-98b7-47ea-9663-35e8fa4c09ca tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:21.720842 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d7b4398c-98b7-47ea-9663-35e8fa4c09ca tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:21.866950 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d7b4398c-98b7-47ea-9663-35e8fa4c09ca tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:21.875005 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d7b4398c-98b7-47ea-9663-35e8fa4c09ca tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:21.876582 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d7b4398c-98b7-47ea-9663-35e8fa4c09ca tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:21.877779 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d7b4398c-98b7-47ea-9663-35e8fa4c09ca tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1724 microversion: 2.20 time: 0.170169 Jun 25 16:12:21.878328 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 351/698] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:12:21 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:12:22.698291 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-f11822c9-9fd7-4809-9429-7300837d58a9 tempest-VolumesTestJSON-1132187115 tempest-VolumesTestJSON-1132187115-project] Calling method '.version_select at 0x7f65bb550c10>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:22.752923 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-f11822c9-9fd7-4809-9429-7300837d58a9 tempest-VolumesTestJSON-1132187115 tempest-VolumesTestJSON-1132187115-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/1de1ab26-6dfe-496c-b1ac-f34565cb5baf" status: 200 len: 351 microversion: 2.1 time: 0.059162 Jun 25 16:12:22.753484 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 348/699] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Jun 25 16:12:22 2022] GET /compute/v2.1/os-volumes/1de1ab26-6dfe-496c-b1ac-f34565cb5baf => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:12:22.895865 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7a775fb6-b361-4270-886e-5d9cd505a1d1 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:22.896609 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7a775fb6-b361-4270-886e-5d9cd505a1d1 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:22.903073 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7a775fb6-b361-4270-886e-5d9cd505a1d1 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:22.903526 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7a775fb6-b361-4270-886e-5d9cd505a1d1 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:22.904346 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7a775fb6-b361-4270-886e-5d9cd505a1d1 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:22.904859 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7a775fb6-b361-4270-886e-5d9cd505a1d1 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:23.052602 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7a775fb6-b361-4270-886e-5d9cd505a1d1 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:23.060718 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7a775fb6-b361-4270-886e-5d9cd505a1d1 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:23.062465 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7a775fb6-b361-4270-886e-5d9cd505a1d1 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:23.063949 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7a775fb6-b361-4270-886e-5d9cd505a1d1 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1724 microversion: 2.20 time: 0.171903 Jun 25 16:12:23.064557 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 352/700] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:12:22 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:12:24.090617 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-b29698c4-c11c-40e5-bcd2-83ba50ba21a4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:24.090617 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-b29698c4-c11c-40e5-bcd2-83ba50ba21a4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:24.090617 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:12:24.097006 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-558bb402-e94f-4769-9c9d-d55b39cf895d tempest-VolumesTestJSON-1132187115 tempest-VolumesTestJSON-1132187115-project] Calling method '.version_select at 0x7f65bb631af0>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:24.097469 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b29698c4-c11c-40e5-bcd2-83ba50ba21a4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:24.097469 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b29698c4-c11c-40e5-bcd2-83ba50ba21a4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:24.097677 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b29698c4-c11c-40e5-bcd2-83ba50ba21a4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:24.097981 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b29698c4-c11c-40e5-bcd2-83ba50ba21a4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:24.146864 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-558bb402-e94f-4769-9c9d-d55b39cf895d tempest-VolumesTestJSON-1132187115 tempest-VolumesTestJSON-1132187115-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/4d0d1bfd-0b47-402d-81de-e60ca8a8a28c" status: 200 len: 351 microversion: 2.1 time: 0.054791 Jun 25 16:12:24.147592 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 353/701] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Jun 25 16:12:24 2022] GET /compute/v2.1/os-volumes/4d0d1bfd-0b47-402d-81de-e60ca8a8a28c => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:12:24.158907 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2570f3ab-b889-48ad-b95a-d05eb6125af2 tempest-VolumesTestJSON-1132187115 tempest-VolumesTestJSON-1132187115-project] Calling method '.version_select at 0x7f65bb5d83a0>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:24.233784 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-b29698c4-c11c-40e5-bcd2-83ba50ba21a4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:24.241045 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2570f3ab-b889-48ad-b95a-d05eb6125af2 tempest-VolumesTestJSON-1132187115 tempest-VolumesTestJSON-1132187115-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086135 Jun 25 16:12:24.241696 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 354/702] 10.222.0.13 () {58 vars in 1133 bytes} [Sat Jun 25 16:12:24 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:12:24.242936 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-b29698c4-c11c-40e5-bcd2-83ba50ba21a4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:24.244483 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-b29698c4-c11c-40e5-bcd2-83ba50ba21a4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:24.245655 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-b29698c4-c11c-40e5-bcd2-83ba50ba21a4 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1724 microversion: 2.20 time: 0.163010 Jun 25 16:12:24.246203 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 349/703] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:12:24 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:12:24.253574 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-620e1cbb-3b6b-4332-980f-381129a0fa11 tempest-VolumesTestJSON-1132187115 tempest-VolumesTestJSON-1132187115-project] Calling method '.version_select at 0x7f65bb7a7820>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:24.334060 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-620e1cbb-3b6b-4332-980f-381129a0fa11 tempest-VolumesTestJSON-1132187115 tempest-VolumesTestJSON-1132187115-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.084088 Jun 25 16:12:24.334622 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 355/704] 10.222.0.13 () {58 vars in 1148 bytes} [Sat Jun 25 16:12:24 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 16:12:24.347165 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-81d42369-c594-4d41-adc6-663587f08878 tempest-VolumesTestJSON-1132187115 tempest-VolumesTestJSON-1132187115-project] Calling method '.version_select at 0x7f65bb56b280>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:24.429098 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-81d42369-c594-4d41-adc6-663587f08878 tempest-VolumesTestJSON-1132187115 tempest-VolumesTestJSON-1132187115-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086152 Jun 25 16:12:24.429681 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 350/705] 10.222.0.13 () {58 vars in 1133 bytes} [Sat Jun 25 16:12:24 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:12:24.442145 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-bd48b539-e024-47e5-b72a-ab37e5c6a879 tempest-VolumesTestJSON-1132187115 tempest-VolumesTestJSON-1132187115-project] Calling method '.version_select at 0x7f65bb5d8e50>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:24.526018 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-bd48b539-e024-47e5-b72a-ab37e5c6a879 tempest-VolumesTestJSON-1132187115 tempest-VolumesTestJSON-1132187115-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087567 Jun 25 16:12:24.526596 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 356/706] 10.222.0.13 () {58 vars in 1166 bytes} [Sat Jun 25 16:12:24 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:12:24.538337 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-24ce35e6-f100-4778-b2d9-d54728f6bbe4 tempest-VolumesTestJSON-1132187115 tempest-VolumesTestJSON-1132187115-project] Calling method '.version_select at 0x7f65bb5945e0>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:24.620718 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-24ce35e6-f100-4778-b2d9-d54728f6bbe4 tempest-VolumesTestJSON-1132187115 tempest-VolumesTestJSON-1132187115-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.086211 Jun 25 16:12:24.621283 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 351/707] 10.222.0.13 () {58 vars in 1169 bytes} [Sat Jun 25 16:12:24 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 16:12:24.633263 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a3888c2d-3c12-46b7-ba5d-e19923f6805f tempest-VolumesTestJSON-1132187115 tempest-VolumesTestJSON-1132187115-project] Calling method '.version_select at 0x7f65bb590f70>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:24.720646 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a3888c2d-3c12-46b7-ba5d-e19923f6805f tempest-VolumesTestJSON-1132187115 tempest-VolumesTestJSON-1132187115-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.091023 Jun 25 16:12:24.721224 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 357/708] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Jun 25 16:12:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:12:24.732723 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-2a42cf9d-f183-479b-b0a7-d8b26099ae11 tempest-VolumesTestJSON-1132187115 tempest-VolumesTestJSON-1132187115-project] Calling method '.version_select at 0x7f65bb550790>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:24.817895 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-2a42cf9d-f183-479b-b0a7-d8b26099ae11 tempest-VolumesTestJSON-1132187115 tempest-VolumesTestJSON-1132187115-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088912 Jun 25 16:12:24.818464 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 352/709] 10.222.0.13 () {58 vars in 1187 bytes} [Sat Jun 25 16:12:24 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:12:24.830760 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-206f9e64-56a3-4a35-a2b5-4f5161631c5c tempest-VolumesTestJSON-1132187115 tempest-VolumesTestJSON-1132187115-project] Calling method '.version_select at 0x7f65bb592ca0>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:24.914623 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-206f9e64-56a3-4a35-a2b5-4f5161631c5c tempest-VolumesTestJSON-1132187115 tempest-VolumesTestJSON-1132187115-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.087724 Jun 25 16:12:24.915197 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 358/710] 10.222.0.13 () {58 vars in 1154 bytes} [Sat Jun 25 16:12:24 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:12:25.265258 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-99504d16-3876-46e8-88eb-edab96247bfc tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:25.265843 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-99504d16-3876-46e8-88eb-edab96247bfc tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:25.272168 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-99504d16-3876-46e8-88eb-edab96247bfc tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:25.272659 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-99504d16-3876-46e8-88eb-edab96247bfc tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:25.273429 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-99504d16-3876-46e8-88eb-edab96247bfc tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:25.273851 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-99504d16-3876-46e8-88eb-edab96247bfc tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:25.276442 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:12:25.427024 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-99504d16-3876-46e8-88eb-edab96247bfc tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:25.438306 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-99504d16-3876-46e8-88eb-edab96247bfc tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:25.439817 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-99504d16-3876-46e8-88eb-edab96247bfc tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:25.441007 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-99504d16-3876-46e8-88eb-edab96247bfc tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1724 microversion: 2.20 time: 0.180200 Jun 25 16:12:25.441547 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 353/711] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:12:25 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:12:26.461544 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-179b2719-8658-487a-8c36-918d23a29aa3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:26.462137 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-179b2719-8658-487a-8c36-918d23a29aa3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:26.469027 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-179b2719-8658-487a-8c36-918d23a29aa3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:26.469539 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-179b2719-8658-487a-8c36-918d23a29aa3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:26.470479 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-179b2719-8658-487a-8c36-918d23a29aa3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:26.470976 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-179b2719-8658-487a-8c36-918d23a29aa3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:26.606329 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-179b2719-8658-487a-8c36-918d23a29aa3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:26.616215 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-179b2719-8658-487a-8c36-918d23a29aa3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:26.617743 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-179b2719-8658-487a-8c36-918d23a29aa3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:26.618898 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-179b2719-8658-487a-8c36-918d23a29aa3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1724 microversion: 2.20 time: 0.161953 Jun 25 16:12:26.619446 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 359/712] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:12:26 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:12:27.653184 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-01427a17-3aa9-4e46-ab31-42af4587f570 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:27.654173 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-01427a17-3aa9-4e46-ab31-42af4587f570 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:27.662945 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-01427a17-3aa9-4e46-ab31-42af4587f570 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:27.663396 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-01427a17-3aa9-4e46-ab31-42af4587f570 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:27.664171 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-01427a17-3aa9-4e46-ab31-42af4587f570 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:27.664665 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-01427a17-3aa9-4e46-ab31-42af4587f570 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:27.807311 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-01427a17-3aa9-4e46-ab31-42af4587f570 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:27.815906 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-01427a17-3aa9-4e46-ab31-42af4587f570 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:27.817433 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-01427a17-3aa9-4e46-ab31-42af4587f570 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:27.818601 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-01427a17-3aa9-4e46-ab31-42af4587f570 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1724 microversion: 2.20 time: 0.172356 Jun 25 16:12:27.819170 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 354/713] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:12:27 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:12:28.837607 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-81ac6c7e-6c94-4bb4-ac9b-b22d6671920c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:28.838211 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-81ac6c7e-6c94-4bb4-ac9b-b22d6671920c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:28.846311 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-81ac6c7e-6c94-4bb4-ac9b-b22d6671920c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:28.846821 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-81ac6c7e-6c94-4bb4-ac9b-b22d6671920c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:28.847623 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-81ac6c7e-6c94-4bb4-ac9b-b22d6671920c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:28.848470 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-81ac6c7e-6c94-4bb4-ac9b-b22d6671920c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:28.999069 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-81ac6c7e-6c94-4bb4-ac9b-b22d6671920c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:29.007344 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-81ac6c7e-6c94-4bb4-ac9b-b22d6671920c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:29.008935 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-81ac6c7e-6c94-4bb4-ac9b-b22d6671920c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:29.010332 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-81ac6c7e-6c94-4bb4-ac9b-b22d6671920c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1724 microversion: 2.20 time: 0.176641 Jun 25 16:12:29.010944 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 360/714] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:12:28 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:12:30.028638 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-f94ec993-5ace-42d1-bf50-42aeba8e2d12 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:30.029274 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-f94ec993-5ace-42d1-bf50-42aeba8e2d12 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:30.035974 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f94ec993-5ace-42d1-bf50-42aeba8e2d12 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:30.036431 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f94ec993-5ace-42d1-bf50-42aeba8e2d12 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:30.037245 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f94ec993-5ace-42d1-bf50-42aeba8e2d12 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:30.037685 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f94ec993-5ace-42d1-bf50-42aeba8e2d12 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:30.173911 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-f94ec993-5ace-42d1-bf50-42aeba8e2d12 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:30.182791 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-f94ec993-5ace-42d1-bf50-42aeba8e2d12 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:30.184440 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-f94ec993-5ace-42d1-bf50-42aeba8e2d12 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:30.185621 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-f94ec993-5ace-42d1-bf50-42aeba8e2d12 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1745 microversion: 2.20 time: 0.160939 Jun 25 16:12:30.186172 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 355/715] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:12:30 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:12:31.204635 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-82d659b5-b1b1-46fa-9579-d60fb5e1902c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:31.205389 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-82d659b5-b1b1-46fa-9579-d60fb5e1902c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:31.212135 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-82d659b5-b1b1-46fa-9579-d60fb5e1902c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:31.212636 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-82d659b5-b1b1-46fa-9579-d60fb5e1902c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:31.213414 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-82d659b5-b1b1-46fa-9579-d60fb5e1902c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:31.213845 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-82d659b5-b1b1-46fa-9579-d60fb5e1902c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:31.347506 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-82d659b5-b1b1-46fa-9579-d60fb5e1902c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:31.360449 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-82d659b5-b1b1-46fa-9579-d60fb5e1902c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:31.361994 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-82d659b5-b1b1-46fa-9579-d60fb5e1902c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:31.363135 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-82d659b5-b1b1-46fa-9579-d60fb5e1902c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1745 microversion: 2.20 time: 0.162477 Jun 25 16:12:31.363707 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 361/716] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:12:31 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:12:32.277109 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-4825424a-776c-4f9e-aaff-38130cee4a99 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:32.278179 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-4825424a-776c-4f9e-aaff-38130cee4a99 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:32.286464 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4825424a-776c-4f9e-aaff-38130cee4a99 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:32.287834 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4825424a-776c-4f9e-aaff-38130cee4a99 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:32.288811 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4825424a-776c-4f9e-aaff-38130cee4a99 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:32.289401 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4825424a-776c-4f9e-aaff-38130cee4a99 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:32.317539 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-4825424a-776c-4f9e-aaff-38130cee4a99 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695/ips" status: 200 len: 145 microversion: 2.1 time: 0.044129 Jun 25 16:12:32.318378 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 356/717] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Jun 25 16:12:32 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695/ips => generated 145 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:12:32.380935 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-152d78bf-34ea-4823-b9ae-d0125dd7c86f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:32.382210 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-152d78bf-34ea-4823-b9ae-d0125dd7c86f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:32.389845 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-152d78bf-34ea-4823-b9ae-d0125dd7c86f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:32.390570 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-152d78bf-34ea-4823-b9ae-d0125dd7c86f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:32.391579 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-152d78bf-34ea-4823-b9ae-d0125dd7c86f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:32.392218 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-152d78bf-34ea-4823-b9ae-d0125dd7c86f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:32.579593 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-152d78bf-34ea-4823-b9ae-d0125dd7c86f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:32.588895 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-152d78bf-34ea-4823-b9ae-d0125dd7c86f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:32.590758 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-152d78bf-34ea-4823-b9ae-d0125dd7c86f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:32.592250 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-152d78bf-34ea-4823-b9ae-d0125dd7c86f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1740 microversion: 2.20 time: 0.215263 Jun 25 16:12:32.593064 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 362/718] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:12:32 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1740 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 16:12:33.614044 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-e5de68ee-2281-4b9b-8e6b-7d84146db5d6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:33.614991 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-e5de68ee-2281-4b9b-8e6b-7d84146db5d6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:33.625471 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e5de68ee-2281-4b9b-8e6b-7d84146db5d6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:33.626636 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e5de68ee-2281-4b9b-8e6b-7d84146db5d6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:33.628104 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e5de68ee-2281-4b9b-8e6b-7d84146db5d6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:33.629083 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e5de68ee-2281-4b9b-8e6b-7d84146db5d6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:33.828615 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-e5de68ee-2281-4b9b-8e6b-7d84146db5d6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:33.836569 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-e5de68ee-2281-4b9b-8e6b-7d84146db5d6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:33.838107 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-e5de68ee-2281-4b9b-8e6b-7d84146db5d6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:33.839307 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-e5de68ee-2281-4b9b-8e6b-7d84146db5d6 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1740 microversion: 2.20 time: 0.231681 Jun 25 16:12:33.839868 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 357/719] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:12:33 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1740 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:12:34.365937 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-03b1ef3f-811b-4a8a-a766-f6ef663b230d req-5bd01414-2e0b-4973-adaa-0c0d57ef5a13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "749fc9b1-a969-425d-b2e4-a88b63a45ffe", "name": "network-vif-plugged", "status": "completed", "tag": "faf6b184-57b1-4bce-bc06-d6f249c9b017"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:12:34.379230 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-03b1ef3f-811b-4a8a-a766-f6ef663b230d req-5bd01414-2e0b-4973-adaa-0c0d57ef5a13 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:34.379912 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-03b1ef3f-811b-4a8a-a766-f6ef663b230d req-5bd01414-2e0b-4973-adaa-0c0d57ef5a13 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:34.396365 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-03b1ef3f-811b-4a8a-a766-f6ef663b230d req-5bd01414-2e0b-4973-adaa-0c0d57ef5a13 service nova] Creating event network-vif-plugged:faf6b184-57b1-4bce-bc06-d6f249c9b017 for instance 749fc9b1-a969-425d-b2e4-a88b63a45ffe on hv-cinder-84762 Jun 25 16:12:34.402137 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-03b1ef3f-811b-4a8a-a766-f6ef663b230d req-5bd01414-2e0b-4973-adaa-0c0d57ef5a13 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.297222 Jun 25 16:12:34.402734 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 363/720] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:12:34.862132 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-d209b9ac-9caa-4fad-b970-3522e50500b7 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:34.863361 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-d209b9ac-9caa-4fad-b970-3522e50500b7 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:34.871005 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d209b9ac-9caa-4fad-b970-3522e50500b7 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:34.871684 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d209b9ac-9caa-4fad-b970-3522e50500b7 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:34.873387 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d209b9ac-9caa-4fad-b970-3522e50500b7 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:34.874675 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d209b9ac-9caa-4fad-b970-3522e50500b7 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:35.039696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d209b9ac-9caa-4fad-b970-3522e50500b7 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:35.052589 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d209b9ac-9caa-4fad-b970-3522e50500b7 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:35.054201 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d209b9ac-9caa-4fad-b970-3522e50500b7 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:35.055394 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-d209b9ac-9caa-4fad-b970-3522e50500b7 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1740 microversion: 2.20 time: 0.198503 Jun 25 16:12:35.055958 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 358/721] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:12:34 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1740 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:12:36.076080 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6f3d0003-79c1-4007-aa78-0c23a6ab8d5d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:36.077771 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6f3d0003-79c1-4007-aa78-0c23a6ab8d5d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:36.085925 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6f3d0003-79c1-4007-aa78-0c23a6ab8d5d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:36.086472 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6f3d0003-79c1-4007-aa78-0c23a6ab8d5d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:36.087378 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6f3d0003-79c1-4007-aa78-0c23a6ab8d5d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:36.087814 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6f3d0003-79c1-4007-aa78-0c23a6ab8d5d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:36.090906 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:12:36.266998 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6f3d0003-79c1-4007-aa78-0c23a6ab8d5d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:36.277306 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6f3d0003-79c1-4007-aa78-0c23a6ab8d5d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:36.278881 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6f3d0003-79c1-4007-aa78-0c23a6ab8d5d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:36.280134 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6f3d0003-79c1-4007-aa78-0c23a6ab8d5d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1740 microversion: 2.20 time: 0.208891 Jun 25 16:12:36.281016 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 364/722] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:12:36 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1740 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:12:36.716567 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-8eccdc1e-7cc6-48e3-ae3a-ccdc74d7a563 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0d958027-2b03-4004-a2a4-50ac691f1019"}} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:12:36.718934 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-8eccdc1e-7cc6-48e3-ae3a-ccdc74d7a563 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:36.728567 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8eccdc1e-7cc6-48e3-ae3a-ccdc74d7a563 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:36.729276 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8eccdc1e-7cc6-48e3-ae3a-ccdc74d7a563 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:36.730251 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8eccdc1e-7cc6-48e3-ae3a-ccdc74d7a563 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:36.730896 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8eccdc1e-7cc6-48e3-ae3a-ccdc74d7a563 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:37.084664 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-8eccdc1e-7cc6-48e3-ae3a-ccdc74d7a563 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "POST /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.372045 Jun 25 16:12:37.085835 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 359/723] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Jun 25 16:12:36 2022] POST /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695/os-volume_attachments => generated 194 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:12:37.298676 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-310b2d6c-305c-4e0e-b308-132f2fb95a1c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:37.300883 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-310b2d6c-305c-4e0e-b308-132f2fb95a1c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:37.309231 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-310b2d6c-305c-4e0e-b308-132f2fb95a1c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:37.309781 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-310b2d6c-305c-4e0e-b308-132f2fb95a1c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:37.310881 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-310b2d6c-305c-4e0e-b308-132f2fb95a1c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:37.311385 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-310b2d6c-305c-4e0e-b308-132f2fb95a1c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:37.492703 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-310b2d6c-305c-4e0e-b308-132f2fb95a1c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:37.501530 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-310b2d6c-305c-4e0e-b308-132f2fb95a1c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:37.503393 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-310b2d6c-305c-4e0e-b308-132f2fb95a1c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:37.505278 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-310b2d6c-305c-4e0e-b308-132f2fb95a1c tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1740 microversion: 2.20 time: 0.210750 Jun 25 16:12:37.506316 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 365/724] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:12:37 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1740 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 16:12:38.551299 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-d1c8f866-9b9d-400b-b10b-d2c1a17be442 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:38.554055 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-d1c8f866-9b9d-400b-b10b-d2c1a17be442 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:38.562620 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d1c8f866-9b9d-400b-b10b-d2c1a17be442 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:38.563073 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d1c8f866-9b9d-400b-b10b-d2c1a17be442 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:38.564065 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d1c8f866-9b9d-400b-b10b-d2c1a17be442 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:38.564628 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d1c8f866-9b9d-400b-b10b-d2c1a17be442 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:38.726407 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d1c8f866-9b9d-400b-b10b-d2c1a17be442 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:38.735772 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d1c8f866-9b9d-400b-b10b-d2c1a17be442 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:38.737444 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d1c8f866-9b9d-400b-b10b-d2c1a17be442 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:38.738697 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-d1c8f866-9b9d-400b-b10b-d2c1a17be442 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1740 microversion: 2.20 time: 0.215623 Jun 25 16:12:38.740738 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 360/725] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:12:38 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1740 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:12:39.766627 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f9e73517-4c54-43c6-8e48-5b4813fae1e9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:39.767308 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f9e73517-4c54-43c6-8e48-5b4813fae1e9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:39.776512 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f9e73517-4c54-43c6-8e48-5b4813fae1e9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:39.777272 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f9e73517-4c54-43c6-8e48-5b4813fae1e9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:39.778041 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f9e73517-4c54-43c6-8e48-5b4813fae1e9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:39.778469 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f9e73517-4c54-43c6-8e48-5b4813fae1e9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:39.950849 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f9e73517-4c54-43c6-8e48-5b4813fae1e9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:39.960503 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f9e73517-4c54-43c6-8e48-5b4813fae1e9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:39.962030 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f9e73517-4c54-43c6-8e48-5b4813fae1e9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:39.963365 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f9e73517-4c54-43c6-8e48-5b4813fae1e9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1740 microversion: 2.20 time: 0.201337 Jun 25 16:12:39.976005 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 366/726] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:12:39 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1740 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:12:40.983953 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-1f93d3ae-cb3c-40c2-b051-730210716d07 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:40.984975 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-1f93d3ae-cb3c-40c2-b051-730210716d07 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:41.004367 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1f93d3ae-cb3c-40c2-b051-730210716d07 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:41.004961 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1f93d3ae-cb3c-40c2-b051-730210716d07 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:41.006945 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1f93d3ae-cb3c-40c2-b051-730210716d07 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:41.008778 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1f93d3ae-cb3c-40c2-b051-730210716d07 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:41.156824 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-1f93d3ae-cb3c-40c2-b051-730210716d07 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:41.165805 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-1f93d3ae-cb3c-40c2-b051-730210716d07 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:41.167646 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-1f93d3ae-cb3c-40c2-b051-730210716d07 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:41.169114 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-1f93d3ae-cb3c-40c2-b051-730210716d07 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1740 microversion: 2.20 time: 0.189819 Jun 25 16:12:41.169920 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 361/727] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:12:40 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1740 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:12:42.188455 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-716183f0-751c-499b-ae29-3ecd7ea49ea0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:42.189065 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-716183f0-751c-499b-ae29-3ecd7ea49ea0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:42.191384 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=28 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:12:42.197073 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-716183f0-751c-499b-ae29-3ecd7ea49ea0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:42.197527 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-716183f0-751c-499b-ae29-3ecd7ea49ea0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:42.198293 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-716183f0-751c-499b-ae29-3ecd7ea49ea0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:42.198737 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-716183f0-751c-499b-ae29-3ecd7ea49ea0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:42.332619 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-716183f0-751c-499b-ae29-3ecd7ea49ea0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:42.340909 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-716183f0-751c-499b-ae29-3ecd7ea49ea0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:42.342603 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-716183f0-751c-499b-ae29-3ecd7ea49ea0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:42.343932 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-716183f0-751c-499b-ae29-3ecd7ea49ea0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1722 microversion: 2.20 time: 0.160060 Jun 25 16:12:42.344596 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 367/728] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:12:42 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:12:43.363390 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-c91a3e4b-36da-453c-bb8c-9320fc360d0a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:43.364024 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-c91a3e4b-36da-453c-bb8c-9320fc360d0a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:43.371031 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-c91a3e4b-36da-453c-bb8c-9320fc360d0a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:43.371484 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-c91a3e4b-36da-453c-bb8c-9320fc360d0a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:43.372254 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-c91a3e4b-36da-453c-bb8c-9320fc360d0a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:43.372727 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-c91a3e4b-36da-453c-bb8c-9320fc360d0a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:43.511453 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-c91a3e4b-36da-453c-bb8c-9320fc360d0a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:43.520708 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-c91a3e4b-36da-453c-bb8c-9320fc360d0a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:43.522218 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-c91a3e4b-36da-453c-bb8c-9320fc360d0a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:43.523387 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-c91a3e4b-36da-453c-bb8c-9320fc360d0a tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1722 microversion: 2.20 time: 0.163998 Jun 25 16:12:43.523952 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 362/729] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:12:43 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:12:44.734699 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a132b0f7-9f6b-45d9-b75c-b95b4cf401da tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:44.735310 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a132b0f7-9f6b-45d9-b75c-b95b4cf401da tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:44.741713 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a132b0f7-9f6b-45d9-b75c-b95b4cf401da tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:44.742161 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a132b0f7-9f6b-45d9-b75c-b95b4cf401da tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:44.742927 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a132b0f7-9f6b-45d9-b75c-b95b4cf401da tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:44.743357 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a132b0f7-9f6b-45d9-b75c-b95b4cf401da tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:44.911028 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a132b0f7-9f6b-45d9-b75c-b95b4cf401da tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:44.919186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a132b0f7-9f6b-45d9-b75c-b95b4cf401da tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:44.921527 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a132b0f7-9f6b-45d9-b75c-b95b4cf401da tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:44.922693 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a132b0f7-9f6b-45d9-b75c-b95b4cf401da tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1722 microversion: 2.20 time: 0.385028 Jun 25 16:12:44.923244 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 368/730] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:12:44 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1722 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:12:45.728732 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-32557b87-a7d8-46ff-9289-2c69dcd37cde tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:12:45.739344 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-32557b87-a7d8-46ff-9289-2c69dcd37cde tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:45.739788 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-32557b87-a7d8-46ff-9289-2c69dcd37cde tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:45.830797 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-32557b87-a7d8-46ff-9289-2c69dcd37cde tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Going to try to stop instance {{(pid=117794) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 25 16:12:45.896710 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-32557b87-a7d8-46ff-9289-2c69dcd37cde tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "POST /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695/action" status: 202 len: 0 microversion: 2.1 time: 0.172149 Jun 25 16:12:45.897848 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 363/731] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Jun 25 16:12:45 2022] POST /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 16:12:45.907360 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ca0f9287-c9fc-4959-b4ea-0897a514bd37 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:45.907968 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ca0f9287-c9fc-4959-b4ea-0897a514bd37 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:45.915177 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ca0f9287-c9fc-4959-b4ea-0897a514bd37 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:45.916120 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ca0f9287-c9fc-4959-b4ea-0897a514bd37 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:45.917265 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ca0f9287-c9fc-4959-b4ea-0897a514bd37 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:45.917908 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ca0f9287-c9fc-4959-b4ea-0897a514bd37 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:45.943135 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-d713b7f8-5b7b-4980-8f82-5dffba6265cb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:45.945351 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-d713b7f8-5b7b-4980-8f82-5dffba6265cb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:45.953522 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d713b7f8-5b7b-4980-8f82-5dffba6265cb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:45.953980 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d713b7f8-5b7b-4980-8f82-5dffba6265cb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:45.954762 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d713b7f8-5b7b-4980-8f82-5dffba6265cb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:45.955203 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d713b7f8-5b7b-4980-8f82-5dffba6265cb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:46.143838 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ca0f9287-c9fc-4959-b4ea-0897a514bd37 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:46.151371 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d713b7f8-5b7b-4980-8f82-5dffba6265cb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:46.155292 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ca0f9287-c9fc-4959-b4ea-0897a514bd37 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1722 microversion: 2.1 time: 0.251409 Jun 25 16:12:46.165859 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 369/732] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:12:45 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1722 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:12:46.165859 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-23afe95e-4870-4a46-a2db-dfccf268fa75 req-9eb63965-881e-43b3-a1cd-4f78ae961c7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "749fc9b1-a969-425d-b2e4-a88b63a45ffe", "name": "network-vif-unplugged", "status": "completed", "tag": "faf6b184-57b1-4bce-bc06-d6f249c9b017"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:12:46.171025 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d713b7f8-5b7b-4980-8f82-5dffba6265cb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:46.172274 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-23afe95e-4870-4a46-a2db-dfccf268fa75 req-9eb63965-881e-43b3-a1cd-4f78ae961c7f service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:46.172274 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-23afe95e-4870-4a46-a2db-dfccf268fa75 req-9eb63965-881e-43b3-a1cd-4f78ae961c7f service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:46.172657 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d713b7f8-5b7b-4980-8f82-5dffba6265cb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:46.173892 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-d713b7f8-5b7b-4980-8f82-5dffba6265cb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1665 microversion: 2.20 time: 0.236731 Jun 25 16:12:46.174461 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 364/733] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:12:45 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1665 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:12:46.184475 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.compute.server_external_events [req-23afe95e-4870-4a46-a2db-dfccf268fa75 req-9eb63965-881e-43b3-a1cd-4f78ae961c7f service nova] Unable to find a host for instance 749fc9b1-a969-425d-b2e4-a88b63a45ffe. Dropping event network-vif-unplugged {{(pid=117793) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 25 16:12:46.185325 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-23afe95e-4870-4a46-a2db-dfccf268fa75 req-9eb63965-881e-43b3-a1cd-4f78ae961c7f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028324 Jun 25 16:12:46.186366 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 370/734] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 25 16:12:46.193464 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-f943ffcd-962b-438f-b92f-6bf9d1383672 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d35f567e-bb02-4bc0-ab33-aaa1bb8d6730"}} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:12:46.194586 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-f943ffcd-962b-438f-b92f-6bf9d1383672 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:46.200590 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f943ffcd-962b-438f-b92f-6bf9d1383672 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:46.201071 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f943ffcd-962b-438f-b92f-6bf9d1383672 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:46.201831 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f943ffcd-962b-438f-b92f-6bf9d1383672 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:46.202296 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f943ffcd-962b-438f-b92f-6bf9d1383672 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:46.435212 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=5,nova_cell1:INSERT=5 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:12:46.548704 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-f943ffcd-962b-438f-b92f-6bf9d1383672 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "POST /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.360923 Jun 25 16:12:46.549319 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 365/735] 10.222.0.13 () {62 vars in 1363 bytes} [Sat Jun 25 16:12:46 2022] POST /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe/os-volume_attachments => generated 188 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 25 16:12:46.674291 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d0a8af44-d89a-4424-93c4-a3684251f756 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:46.674787 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d0a8af44-d89a-4424-93c4-a3684251f756 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:46.681983 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d0a8af44-d89a-4424-93c4-a3684251f756 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:46.682565 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d0a8af44-d89a-4424-93c4-a3684251f756 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:46.683713 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d0a8af44-d89a-4424-93c4-a3684251f756 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:46.684351 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d0a8af44-d89a-4424-93c4-a3684251f756 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:46.944526 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d0a8af44-d89a-4424-93c4-a3684251f756 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "DELETE /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe/os-volume_attachments/d35f567e-bb02-4bc0-ab33-aaa1bb8d6730" status: 202 len: 0 microversion: 2.20 time: 0.274683 Jun 25 16:12:46.948199 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 371/736] 10.222.0.13 () {60 vars in 1456 bytes} [Sat Jun 25 16:12:46 2022] DELETE /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe/os-volume_attachments/d35f567e-bb02-4bc0-ab33-aaa1bb8d6730 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 25 16:12:47.008584 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-7450d127-b312-4ccb-8afb-b6bf11e8e012 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:12:47.009153 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-7450d127-b312-4ccb-8afb-b6bf11e8e012 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:47.017362 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7450d127-b312-4ccb-8afb-b6bf11e8e012 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:47.017819 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7450d127-b312-4ccb-8afb-b6bf11e8e012 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:47.018627 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7450d127-b312-4ccb-8afb-b6bf11e8e012 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:47.019066 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7450d127-b312-4ccb-8afb-b6bf11e8e012 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:47.105906 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-7450d127-b312-4ccb-8afb-b6bf11e8e012 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "POST /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe/action" status: 202 len: 0 microversion: 2.20 time: 0.101234 Jun 25 16:12:47.106639 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 366/737] 10.222.0.13 () {62 vars in 1318 bytes} [Sat Jun 25 16:12:47 2022] POST /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 25 16:12:47.116765 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-92c98239-c79f-472c-8109-7046e75f4ce7 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:47.117013 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-92c98239-c79f-472c-8109-7046e75f4ce7 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:47.124340 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-92c98239-c79f-472c-8109-7046e75f4ce7 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:47.124986 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-92c98239-c79f-472c-8109-7046e75f4ce7 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:47.125896 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-92c98239-c79f-472c-8109-7046e75f4ce7 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:47.126637 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-92c98239-c79f-472c-8109-7046e75f4ce7 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:47.175024 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-58f0928a-920b-4de5-9a3a-01db4b681ab7 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:47.175685 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-58f0928a-920b-4de5-9a3a-01db4b681ab7 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:47.182507 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-58f0928a-920b-4de5-9a3a-01db4b681ab7 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:47.182964 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-58f0928a-920b-4de5-9a3a-01db4b681ab7 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:47.184150 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-58f0928a-920b-4de5-9a3a-01db4b681ab7 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:47.184991 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-58f0928a-920b-4de5-9a3a-01db4b681ab7 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:47.320064 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-92c98239-c79f-472c-8109-7046e75f4ce7 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:47.329961 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-92c98239-c79f-472c-8109-7046e75f4ce7 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:47.331867 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-92c98239-c79f-472c-8109-7046e75f4ce7 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:47.333302 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-92c98239-c79f-472c-8109-7046e75f4ce7 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1673 microversion: 2.20 time: 0.221998 Jun 25 16:12:47.334052 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 372/738] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:12:47 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1673 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:12:47.355021 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-58f0928a-920b-4de5-9a3a-01db4b681ab7 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:47.363166 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-58f0928a-920b-4de5-9a3a-01db4b681ab7 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1722 microversion: 2.1 time: 0.193800 Jun 25 16:12:47.363752 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 367/739] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:12:47 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:12:48.352441 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-94badb0f-9cad-4412-984c-40ef93e90805 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:48.353165 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-94badb0f-9cad-4412-984c-40ef93e90805 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:48.359874 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-94badb0f-9cad-4412-984c-40ef93e90805 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:48.360329 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-94badb0f-9cad-4412-984c-40ef93e90805 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:48.361119 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-94badb0f-9cad-4412-984c-40ef93e90805 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:48.361560 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-94badb0f-9cad-4412-984c-40ef93e90805 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:48.380729 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-bc39834c-fad2-48fa-bb3d-05cea22f0792 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:48.381519 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-bc39834c-fad2-48fa-bb3d-05cea22f0792 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:48.388383 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-bc39834c-fad2-48fa-bb3d-05cea22f0792 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:48.389018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-bc39834c-fad2-48fa-bb3d-05cea22f0792 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:48.390239 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-bc39834c-fad2-48fa-bb3d-05cea22f0792 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:48.390754 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-bc39834c-fad2-48fa-bb3d-05cea22f0792 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:48.566716 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-94badb0f-9cad-4412-984c-40ef93e90805 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:48.575130 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-bc39834c-fad2-48fa-bb3d-05cea22f0792 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:48.575798 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-94badb0f-9cad-4412-984c-40ef93e90805 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:48.578519 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-94badb0f-9cad-4412-984c-40ef93e90805 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:48.579697 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-94badb0f-9cad-4412-984c-40ef93e90805 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1731 microversion: 2.20 time: 0.231280 Jun 25 16:12:48.585097 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-bc39834c-fad2-48fa-bb3d-05cea22f0792 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1722 microversion: 2.1 time: 0.208024 Jun 25 16:12:48.591817 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 373/740] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:12:48 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1731 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:12:48.596199 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 368/741] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:12:48 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:12:49.599195 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4b8cea1b-e8fe-4db9-bb38-4d7a79789317 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:49.599881 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4b8cea1b-e8fe-4db9-bb38-4d7a79789317 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:49.604093 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-4267ec60-426c-4ed2-b357-914fc1aaf95b tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:49.605475 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-4267ec60-426c-4ed2-b357-914fc1aaf95b tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:49.614329 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4267ec60-426c-4ed2-b357-914fc1aaf95b tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:49.615414 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4267ec60-426c-4ed2-b357-914fc1aaf95b tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:49.616607 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4267ec60-426c-4ed2-b357-914fc1aaf95b tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:49.617117 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4b8cea1b-e8fe-4db9-bb38-4d7a79789317 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:49.617546 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4267ec60-426c-4ed2-b357-914fc1aaf95b tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:49.617742 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4b8cea1b-e8fe-4db9-bb38-4d7a79789317 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:49.619040 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4b8cea1b-e8fe-4db9-bb38-4d7a79789317 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:49.619678 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4b8cea1b-e8fe-4db9-bb38-4d7a79789317 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:49.835096 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4b8cea1b-e8fe-4db9-bb38-4d7a79789317 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:49.844903 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4b8cea1b-e8fe-4db9-bb38-4d7a79789317 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:49.846773 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-4b8cea1b-e8fe-4db9-bb38-4d7a79789317 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:49.848292 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4b8cea1b-e8fe-4db9-bb38-4d7a79789317 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1731 microversion: 2.20 time: 0.253167 Jun 25 16:12:49.849337 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 374/742] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:12:49 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1731 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:12:49.878464 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-4267ec60-426c-4ed2-b357-914fc1aaf95b tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:49.887183 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-4267ec60-426c-4ed2-b357-914fc1aaf95b tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1722 microversion: 2.1 time: 0.287864 Jun 25 16:12:49.896842 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 369/743] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:12:49 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1722 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:12:50.867412 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-fb29950f-a2f5-441b-9b68-2a3e8ffe9378 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:50.874996 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-fb29950f-a2f5-441b-9b68-2a3e8ffe9378 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:50.883417 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fb29950f-a2f5-441b-9b68-2a3e8ffe9378 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:50.884173 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fb29950f-a2f5-441b-9b68-2a3e8ffe9378 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:50.885841 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fb29950f-a2f5-441b-9b68-2a3e8ffe9378 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:50.886435 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fb29950f-a2f5-441b-9b68-2a3e8ffe9378 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:50.908607 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-406d4bb1-b80d-47ee-b67d-a41046790ca6 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:50.913331 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-406d4bb1-b80d-47ee-b67d-a41046790ca6 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:50.932875 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-406d4bb1-b80d-47ee-b67d-a41046790ca6 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:50.933338 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-406d4bb1-b80d-47ee-b67d-a41046790ca6 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:50.934132 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-406d4bb1-b80d-47ee-b67d-a41046790ca6 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:50.934570 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-406d4bb1-b80d-47ee-b67d-a41046790ca6 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:51.097617 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fb29950f-a2f5-441b-9b68-2a3e8ffe9378 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:51.106139 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fb29950f-a2f5-441b-9b68-2a3e8ffe9378 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:51.108082 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fb29950f-a2f5-441b-9b68-2a3e8ffe9378 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:51.109046 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-fb29950f-a2f5-441b-9b68-2a3e8ffe9378 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1731 microversion: 2.20 time: 0.245528 Jun 25 16:12:51.109922 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 375/744] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:12:50 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1731 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:12:51.124805 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-406d4bb1-b80d-47ee-b67d-a41046790ca6 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:51.134109 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-406d4bb1-b80d-47ee-b67d-a41046790ca6 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1722 microversion: 2.1 time: 0.229768 Jun 25 16:12:51.134706 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 370/745] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:12:50 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:12:52.140180 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-aed65646-9741-4275-a43c-d00b077b6332 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:52.140831 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-aed65646-9741-4275-a43c-d00b077b6332 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:52.149155 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aed65646-9741-4275-a43c-d00b077b6332 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:52.149995 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aed65646-9741-4275-a43c-d00b077b6332 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:52.150946 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aed65646-9741-4275-a43c-d00b077b6332 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:52.151527 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aed65646-9741-4275-a43c-d00b077b6332 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:52.162316 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-8817009f-b26b-4b73-9e73-3b74232f96f0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:52.163458 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-8817009f-b26b-4b73-9e73-3b74232f96f0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:52.173075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8817009f-b26b-4b73-9e73-3b74232f96f0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:52.176851 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8817009f-b26b-4b73-9e73-3b74232f96f0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:52.178105 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8817009f-b26b-4b73-9e73-3b74232f96f0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:52.178937 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8817009f-b26b-4b73-9e73-3b74232f96f0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:52.425163 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-8817009f-b26b-4b73-9e73-3b74232f96f0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:52.429762 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-aed65646-9741-4275-a43c-d00b077b6332 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:52.433837 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-8817009f-b26b-4b73-9e73-3b74232f96f0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1722 microversion: 2.1 time: 0.275622 Jun 25 16:12:52.441284 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-aed65646-9741-4275-a43c-d00b077b6332 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:52.443006 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-aed65646-9741-4275-a43c-d00b077b6332 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:52.443806 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 371/746] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:12:52 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1722 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:12:52.444326 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-aed65646-9741-4275-a43c-d00b077b6332 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1731 microversion: 2.20 time: 0.318428 Jun 25 16:12:52.444913 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 376/747] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:12:52 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1731 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:12:53.454531 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-5f11e081-efc3-44d0-96ea-0aaa3de680b1 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:53.455255 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-5f11e081-efc3-44d0-96ea-0aaa3de680b1 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:53.462579 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5f11e081-efc3-44d0-96ea-0aaa3de680b1 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:53.462892 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b56e25c4-6080-40c1-88af-a467679c267d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:53.463384 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5f11e081-efc3-44d0-96ea-0aaa3de680b1 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:53.463721 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5f11e081-efc3-44d0-96ea-0aaa3de680b1 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:53.464160 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5f11e081-efc3-44d0-96ea-0aaa3de680b1 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:53.464312 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b56e25c4-6080-40c1-88af-a467679c267d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:53.471105 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b56e25c4-6080-40c1-88af-a467679c267d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:53.471532 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b56e25c4-6080-40c1-88af-a467679c267d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:53.472384 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b56e25c4-6080-40c1-88af-a467679c267d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:53.473030 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b56e25c4-6080-40c1-88af-a467679c267d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:53.959916 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-5f11e081-efc3-44d0-96ea-0aaa3de680b1 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:53.969039 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-5f11e081-efc3-44d0-96ea-0aaa3de680b1 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1722 microversion: 2.1 time: 0.520241 Jun 25 16:12:53.969630 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 372/748] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:12:53 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1722 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:12:53.973456 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b56e25c4-6080-40c1-88af-a467679c267d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:53.986207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b56e25c4-6080-40c1-88af-a467679c267d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:53.988570 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b56e25c4-6080-40c1-88af-a467679c267d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:53.990259 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b56e25c4-6080-40c1-88af-a467679c267d tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1731 microversion: 2.20 time: 0.531306 Jun 25 16:12:53.991408 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 377/749] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:12:53 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1731 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:12:54.986171 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-a0c561cd-d021-4670-8cd5-b1656bbe0c8a tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:54.987610 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-a0c561cd-d021-4670-8cd5-b1656bbe0c8a tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:54.990110 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_api:SELECT=44 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:12:54.995907 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a0c561cd-d021-4670-8cd5-b1656bbe0c8a tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:54.996362 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a0c561cd-d021-4670-8cd5-b1656bbe0c8a tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:54.997171 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a0c561cd-d021-4670-8cd5-b1656bbe0c8a tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:54.997590 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a0c561cd-d021-4670-8cd5-b1656bbe0c8a tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:55.010993 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-15c57837-5bfc-4746-9ae5-0ea61d5d5924 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:55.011578 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-15c57837-5bfc-4746-9ae5-0ea61d5d5924 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:55.019340 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-15c57837-5bfc-4746-9ae5-0ea61d5d5924 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:55.019864 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-15c57837-5bfc-4746-9ae5-0ea61d5d5924 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:55.020738 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-15c57837-5bfc-4746-9ae5-0ea61d5d5924 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:55.021483 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-15c57837-5bfc-4746-9ae5-0ea61d5d5924 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:55.218415 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-a0c561cd-d021-4670-8cd5-b1656bbe0c8a tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:55.222138 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-15c57837-5bfc-4746-9ae5-0ea61d5d5924 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:55.226591 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:12:55.232190 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-15c57837-5bfc-4746-9ae5-0ea61d5d5924 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:55.234278 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-a0c561cd-d021-4670-8cd5-b1656bbe0c8a tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1722 microversion: 2.1 time: 0.251978 Jun 25 16:12:55.234758 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-15c57837-5bfc-4746-9ae5-0ea61d5d5924 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:55.235936 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-15c57837-5bfc-4746-9ae5-0ea61d5d5924 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1731 microversion: 2.20 time: 0.229226 Jun 25 16:12:55.236808 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 378/750] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:12:55 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1731 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:12:55.237564 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 373/751] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:12:54 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:12:56.254883 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-80088088-bd2f-4826-8652-e333c93505e3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:56.255474 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-65289d0e-4957-41f2-a372-4bb3eee1445e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:56.256000 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-65289d0e-4957-41f2-a372-4bb3eee1445e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:56.256873 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-80088088-bd2f-4826-8652-e333c93505e3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:56.263071 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-65289d0e-4957-41f2-a372-4bb3eee1445e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:56.263633 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-65289d0e-4957-41f2-a372-4bb3eee1445e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:56.264603 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-80088088-bd2f-4826-8652-e333c93505e3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:56.264827 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-65289d0e-4957-41f2-a372-4bb3eee1445e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:56.265235 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-80088088-bd2f-4826-8652-e333c93505e3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:56.265352 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-65289d0e-4957-41f2-a372-4bb3eee1445e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:56.266105 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-80088088-bd2f-4826-8652-e333c93505e3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:56.266639 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-80088088-bd2f-4826-8652-e333c93505e3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:56.470507 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-65289d0e-4957-41f2-a372-4bb3eee1445e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:56.479034 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-65289d0e-4957-41f2-a372-4bb3eee1445e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1722 microversion: 2.1 time: 0.228151 Jun 25 16:12:56.479847 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 374/752] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:12:56 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:12:56.496679 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-80088088-bd2f-4826-8652-e333c93505e3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:56.509442 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-80088088-bd2f-4826-8652-e333c93505e3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:56.511664 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-80088088-bd2f-4826-8652-e333c93505e3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:56.513312 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-80088088-bd2f-4826-8652-e333c93505e3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1731 microversion: 2.20 time: 0.262579 Jun 25 16:12:56.522980 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 379/753] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:12:56 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1731 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:12:57.508642 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-23c04048-9a5b-4c4d-93ff-b6c4e9b0c384 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:57.509357 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-23c04048-9a5b-4c4d-93ff-b6c4e9b0c384 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:57.516924 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-23c04048-9a5b-4c4d-93ff-b6c4e9b0c384 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:57.517368 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-23c04048-9a5b-4c4d-93ff-b6c4e9b0c384 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:57.518176 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-23c04048-9a5b-4c4d-93ff-b6c4e9b0c384 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:57.519048 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-23c04048-9a5b-4c4d-93ff-b6c4e9b0c384 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:57.533272 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-197d6a89-318b-48da-905e-72046a69b1c3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:57.533935 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-197d6a89-318b-48da-905e-72046a69b1c3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:57.540556 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-197d6a89-318b-48da-905e-72046a69b1c3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:57.541113 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-197d6a89-318b-48da-905e-72046a69b1c3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:57.541767 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-197d6a89-318b-48da-905e-72046a69b1c3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:57.542221 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-197d6a89-318b-48da-905e-72046a69b1c3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:57.728275 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-23c04048-9a5b-4c4d-93ff-b6c4e9b0c384 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:57.731292 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-197d6a89-318b-48da-905e-72046a69b1c3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:57.737788 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-23c04048-9a5b-4c4d-93ff-b6c4e9b0c384 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1722 microversion: 2.1 time: 0.233144 Jun 25 16:12:57.738411 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 375/754] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:12:57 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:12:57.739541 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-197d6a89-318b-48da-905e-72046a69b1c3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:57.741066 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-197d6a89-318b-48da-905e-72046a69b1c3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:57.742216 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-197d6a89-318b-48da-905e-72046a69b1c3 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1731 microversion: 2.20 time: 0.212949 Jun 25 16:12:57.742729 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 380/755] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:12:57 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1731 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:12:58.755558 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-865b24cc-cf43-4bf8-be2e-41b9d9012115 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:58.756844 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-865b24cc-cf43-4bf8-be2e-41b9d9012115 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:58.763674 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-886c4a17-1c96-4f78-8a79-a867334b6fc0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:58.764781 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-865b24cc-cf43-4bf8-be2e-41b9d9012115 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:58.764973 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-865b24cc-cf43-4bf8-be2e-41b9d9012115 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:58.765820 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-886c4a17-1c96-4f78-8a79-a867334b6fc0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:58.766013 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-865b24cc-cf43-4bf8-be2e-41b9d9012115 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:58.766459 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-865b24cc-cf43-4bf8-be2e-41b9d9012115 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:58.773277 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-886c4a17-1c96-4f78-8a79-a867334b6fc0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:58.773739 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-886c4a17-1c96-4f78-8a79-a867334b6fc0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:58.774484 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-886c4a17-1c96-4f78-8a79-a867334b6fc0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:58.774930 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-886c4a17-1c96-4f78-8a79-a867334b6fc0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:58.994028 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-886c4a17-1c96-4f78-8a79-a867334b6fc0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:58.997182 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-865b24cc-cf43-4bf8-be2e-41b9d9012115 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:59.003304 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-886c4a17-1c96-4f78-8a79-a867334b6fc0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:59.004967 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-886c4a17-1c96-4f78-8a79-a867334b6fc0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:59.006077 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-865b24cc-cf43-4bf8-be2e-41b9d9012115 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1699 microversion: 2.1 time: 0.254455 Jun 25 16:12:59.006218 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-886c4a17-1c96-4f78-8a79-a867334b6fc0 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1731 microversion: 2.20 time: 0.248439 Jun 25 16:12:59.006643 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 381/756] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:12:58 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1731 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:12:59.006774 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 376/757] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:12:58 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1699 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:12:59.022687 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-af67e4b3-0980-415e-b881-168dcfa7976d tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:12:59.029286 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-af67e4b3-0980-415e-b881-168dcfa7976d tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:59.029813 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-af67e4b3-0980-415e-b881-168dcfa7976d tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:59.104118 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-af67e4b3-0980-415e-b881-168dcfa7976d tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Going to try to start instance {{(pid=117793) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 25 16:12:59.153832 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-af67e4b3-0980-415e-b881-168dcfa7976d tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "POST /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695/action" status: 202 len: 0 microversion: 2.1 time: 0.134241 Jun 25 16:12:59.154837 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 382/758] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Jun 25 16:12:59 2022] POST /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 16:12:59.163105 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-7a02f3e2-90fd-499f-9843-87610b34ec20 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:12:59.163697 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-7a02f3e2-90fd-499f-9843-87610b34ec20 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:12:59.171447 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7a02f3e2-90fd-499f-9843-87610b34ec20 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:59.171905 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7a02f3e2-90fd-499f-9843-87610b34ec20 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:59.172974 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7a02f3e2-90fd-499f-9843-87610b34ec20 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:12:59.173427 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7a02f3e2-90fd-499f-9843-87610b34ec20 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:12:59.314210 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-7a02f3e2-90fd-499f-9843-87610b34ec20 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:12:59.322407 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-7a02f3e2-90fd-499f-9843-87610b34ec20 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1708 microversion: 2.1 time: 0.163224 Jun 25 16:12:59.322972 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 377/759] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:12:59 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1708 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:13:00.026020 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-25ff8d53-57a6-4b03-b0d3-7398a188f5cb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:00.026635 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-25ff8d53-57a6-4b03-b0d3-7398a188f5cb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:00.032951 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-25ff8d53-57a6-4b03-b0d3-7398a188f5cb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:00.033391 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-25ff8d53-57a6-4b03-b0d3-7398a188f5cb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:00.034176 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-25ff8d53-57a6-4b03-b0d3-7398a188f5cb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:00.034606 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-25ff8d53-57a6-4b03-b0d3-7398a188f5cb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:00.177417 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-25ff8d53-57a6-4b03-b0d3-7398a188f5cb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:00.190210 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-25ff8d53-57a6-4b03-b0d3-7398a188f5cb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:00.191945 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-25ff8d53-57a6-4b03-b0d3-7398a188f5cb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:00.193779 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-25ff8d53-57a6-4b03-b0d3-7398a188f5cb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1731 microversion: 2.20 time: 0.172498 Jun 25 16:13:00.194826 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 383/760] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:13:00 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:13:00.339425 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-a006915d-0c33-4fee-aac5-58b5453d35ba tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:00.340066 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-a006915d-0c33-4fee-aac5-58b5453d35ba tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:00.346727 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a006915d-0c33-4fee-aac5-58b5453d35ba tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:00.347211 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a006915d-0c33-4fee-aac5-58b5453d35ba tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:00.347985 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a006915d-0c33-4fee-aac5-58b5453d35ba tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:00.348445 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a006915d-0c33-4fee-aac5-58b5453d35ba tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:00.481847 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-a006915d-0c33-4fee-aac5-58b5453d35ba tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:00.490595 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-a006915d-0c33-4fee-aac5-58b5453d35ba tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1712 microversion: 2.1 time: 0.155345 Jun 25 16:13:00.491168 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 378/761] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:00 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1712 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:13:01.217274 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9b21d2e7-5109-46a6-ba47-accc844347be tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:01.217909 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9b21d2e7-5109-46a6-ba47-accc844347be tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:01.225036 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9b21d2e7-5109-46a6-ba47-accc844347be tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:01.225475 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9b21d2e7-5109-46a6-ba47-accc844347be tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:01.226225 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9b21d2e7-5109-46a6-ba47-accc844347be tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:01.226652 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9b21d2e7-5109-46a6-ba47-accc844347be tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:01.364333 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9b21d2e7-5109-46a6-ba47-accc844347be tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:01.372616 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9b21d2e7-5109-46a6-ba47-accc844347be tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:01.374210 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9b21d2e7-5109-46a6-ba47-accc844347be tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:01.375354 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9b21d2e7-5109-46a6-ba47-accc844347be tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1731 microversion: 2.20 time: 0.165290 Jun 25 16:13:01.375948 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 384/762] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:13:01 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:13:02.400126 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-cc175294-ee12-4067-b508-042c1c3f23a5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:02.400718 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-cc175294-ee12-4067-b508-042c1c3f23a5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:02.407784 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cc175294-ee12-4067-b508-042c1c3f23a5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:02.408162 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cc175294-ee12-4067-b508-042c1c3f23a5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:02.408975 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cc175294-ee12-4067-b508-042c1c3f23a5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:02.409412 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cc175294-ee12-4067-b508-042c1c3f23a5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:02.554142 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-cc175294-ee12-4067-b508-042c1c3f23a5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:02.566402 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-cc175294-ee12-4067-b508-042c1c3f23a5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:02.568734 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-cc175294-ee12-4067-b508-042c1c3f23a5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:02.570442 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-cc175294-ee12-4067-b508-042c1c3f23a5 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1731 microversion: 2.20 time: 0.174050 Jun 25 16:13:02.571198 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 379/763] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:13:02 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:13:03.594192 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b59ca51b-ee21-4bf8-8e12-26ff2ef34b13 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:03.595330 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b59ca51b-ee21-4bf8-8e12-26ff2ef34b13 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:03.603109 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b59ca51b-ee21-4bf8-8e12-26ff2ef34b13 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:03.603839 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b59ca51b-ee21-4bf8-8e12-26ff2ef34b13 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:03.605012 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b59ca51b-ee21-4bf8-8e12-26ff2ef34b13 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:03.605601 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b59ca51b-ee21-4bf8-8e12-26ff2ef34b13 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:03.744715 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b59ca51b-ee21-4bf8-8e12-26ff2ef34b13 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:03.754660 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b59ca51b-ee21-4bf8-8e12-26ff2ef34b13 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:03.756141 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b59ca51b-ee21-4bf8-8e12-26ff2ef34b13 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:03.757036 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-aeac87ad-c7b7-4f8f-a4d0-c5213f3aa3d0 req-12a16611-a182-42f2-8be6-33fdcf990d03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "749fc9b1-a969-425d-b2e4-a88b63a45ffe", "name": "network-vif-plugged", "status": "completed", "tag": "faf6b184-57b1-4bce-bc06-d6f249c9b017"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:13:03.757556 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b59ca51b-ee21-4bf8-8e12-26ff2ef34b13 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1731 microversion: 2.20 time: 0.168618 Jun 25 16:13:03.757876 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 385/764] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:13:03 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 25 16:13:03.768170 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-aeac87ad-c7b7-4f8f-a4d0-c5213f3aa3d0 req-12a16611-a182-42f2-8be6-33fdcf990d03 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:03.768637 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-aeac87ad-c7b7-4f8f-a4d0-c5213f3aa3d0 req-12a16611-a182-42f2-8be6-33fdcf990d03 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:03.780869 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-aeac87ad-c7b7-4f8f-a4d0-c5213f3aa3d0 req-12a16611-a182-42f2-8be6-33fdcf990d03 service nova] Creating event network-vif-plugged:faf6b184-57b1-4bce-bc06-d6f249c9b017 for instance 749fc9b1-a969-425d-b2e4-a88b63a45ffe on hv-cinder-84762 Jun 25 16:13:03.785799 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-aeac87ad-c7b7-4f8f-a4d0-c5213f3aa3d0 req-12a16611-a182-42f2-8be6-33fdcf990d03 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033055 Jun 25 16:13:03.786397 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 380/765] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:13:04.777363 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-851d314b-29bb-4414-af2d-2265d88d2124 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:04.777931 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-851d314b-29bb-4414-af2d-2265d88d2124 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:04.784961 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-851d314b-29bb-4414-af2d-2265d88d2124 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:04.785460 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-851d314b-29bb-4414-af2d-2265d88d2124 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:04.786222 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-851d314b-29bb-4414-af2d-2265d88d2124 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:04.786657 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-851d314b-29bb-4414-af2d-2265d88d2124 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:04.921036 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-851d314b-29bb-4414-af2d-2265d88d2124 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:04.930186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-851d314b-29bb-4414-af2d-2265d88d2124 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:04.931681 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-851d314b-29bb-4414-af2d-2265d88d2124 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:04.932959 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-851d314b-29bb-4414-af2d-2265d88d2124 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1731 microversion: 2.20 time: 0.159826 Jun 25 16:13:04.933521 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 386/766] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:13:04 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:13:05.953675 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-d2b872c0-1eb5-4e67-b0a0-7b1a5148386b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:05.954375 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-d2b872c0-1eb5-4e67-b0a0-7b1a5148386b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:05.961309 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d2b872c0-1eb5-4e67-b0a0-7b1a5148386b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:05.961780 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d2b872c0-1eb5-4e67-b0a0-7b1a5148386b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:05.962558 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d2b872c0-1eb5-4e67-b0a0-7b1a5148386b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:05.962995 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d2b872c0-1eb5-4e67-b0a0-7b1a5148386b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:05.979128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:13:06.114714 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d2b872c0-1eb5-4e67-b0a0-7b1a5148386b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:06.122923 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d2b872c0-1eb5-4e67-b0a0-7b1a5148386b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:06.124546 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d2b872c0-1eb5-4e67-b0a0-7b1a5148386b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:06.125699 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-d2b872c0-1eb5-4e67-b0a0-7b1a5148386b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1718 microversion: 2.20 time: 0.177213 Jun 25 16:13:06.126283 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 381/767] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:13:05 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1718 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:13:09.233797 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-70f3446c-f947-420b-a72a-648edc8f4d06 req-10d8f8eb-6e7c-41d1-b3ae-5fc8c54e3e4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "affce264-2942-4aa8-850e-96642d84eff3", "tag": "166dd48f-5e8c-48ce-8be5-c39460c7ef08"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:13:09.234472 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a0e5eafe-e76c-4855-bfb2-4c5907a8f999 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:09.234472 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a0e5eafe-e76c-4855-bfb2-4c5907a8f999 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:09.242138 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a0e5eafe-e76c-4855-bfb2-4c5907a8f999 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:09.242667 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a0e5eafe-e76c-4855-bfb2-4c5907a8f999 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:09.243693 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a0e5eafe-e76c-4855-bfb2-4c5907a8f999 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:09.244377 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a0e5eafe-e76c-4855-bfb2-4c5907a8f999 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:09.245426 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-70f3446c-f947-420b-a72a-648edc8f4d06 req-10d8f8eb-6e7c-41d1-b3ae-5fc8c54e3e4e service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:09.246100 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-70f3446c-f947-420b-a72a-648edc8f4d06 req-10d8f8eb-6e7c-41d1-b3ae-5fc8c54e3e4e service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:09.261051 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-70f3446c-f947-420b-a72a-648edc8f4d06 req-10d8f8eb-6e7c-41d1-b3ae-5fc8c54e3e4e service nova] Creating event network-changed:166dd48f-5e8c-48ce-8be5-c39460c7ef08 for instance affce264-2942-4aa8-850e-96642d84eff3 on hv-cinder-84762 Jun 25 16:13:09.267151 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-70f3446c-f947-420b-a72a-648edc8f4d06 req-10d8f8eb-6e7c-41d1-b3ae-5fc8c54e3e4e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037050 Jun 25 16:13:09.268263 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 382/768] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:13:09.285627 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a0e5eafe-e76c-4855-bfb2-4c5907a8f999 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 16:13:09.380457 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a0e5eafe-e76c-4855-bfb2-4c5907a8f999 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "DELETE /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 204 len: 0 microversion: 2.1 time: 0.150100 Jun 25 16:13:09.385153 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 387/769] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Jun 25 16:13:09 2022] DELETE /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 16:13:09.391084 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-bb99b43a-2c2d-4e3c-b0ba-0503ef2bd254 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:09.391788 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-bb99b43a-2c2d-4e3c-b0ba-0503ef2bd254 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:09.398765 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-bb99b43a-2c2d-4e3c-b0ba-0503ef2bd254 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:09.399482 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-bb99b43a-2c2d-4e3c-b0ba-0503ef2bd254 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:09.400435 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-bb99b43a-2c2d-4e3c-b0ba-0503ef2bd254 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:09.401030 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-bb99b43a-2c2d-4e3c-b0ba-0503ef2bd254 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:09.558828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-bb99b43a-2c2d-4e3c-b0ba-0503ef2bd254 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:09.568497 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-bb99b43a-2c2d-4e3c-b0ba-0503ef2bd254 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1569 microversion: 2.1 time: 0.181865 Jun 25 16:13:09.568940 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 383/770] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:09 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1569 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:13:10.586588 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d9bc7300-bd70-49c7-a41d-13ac31eb09b5 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:10.587902 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d9bc7300-bd70-49c7-a41d-13ac31eb09b5 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:10.594522 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d9bc7300-bd70-49c7-a41d-13ac31eb09b5 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:10.594977 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d9bc7300-bd70-49c7-a41d-13ac31eb09b5 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:10.595743 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d9bc7300-bd70-49c7-a41d-13ac31eb09b5 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:10.596177 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d9bc7300-bd70-49c7-a41d-13ac31eb09b5 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:10.790507 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d9bc7300-bd70-49c7-a41d-13ac31eb09b5 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:10.798945 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d9bc7300-bd70-49c7-a41d-13ac31eb09b5 tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1569 microversion: 2.1 time: 0.216514 Jun 25 16:13:10.801053 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 388/771] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:10 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1569 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:13:11.521438 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-3adcdd80-807e-450f-aa21-47e7636df967 req-ff1e5c36-2f2a-40a6-840c-f3dd818462e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "affce264-2942-4aa8-850e-96642d84eff3", "name": "network-vif-deleted", "tag": "166dd48f-5e8c-48ce-8be5-c39460c7ef08"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:13:11.534088 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-3adcdd80-807e-450f-aa21-47e7636df967 req-ff1e5c36-2f2a-40a6-840c-f3dd818462e5 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:11.540932 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-3adcdd80-807e-450f-aa21-47e7636df967 req-ff1e5c36-2f2a-40a6-840c-f3dd818462e5 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:11.560226 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-3adcdd80-807e-450f-aa21-47e7636df967 req-ff1e5c36-2f2a-40a6-840c-f3dd818462e5 service nova] Creating event network-vif-deleted:166dd48f-5e8c-48ce-8be5-c39460c7ef08 for instance affce264-2942-4aa8-850e-96642d84eff3 on hv-cinder-84762 Jun 25 16:13:11.565085 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-3adcdd80-807e-450f-aa21-47e7636df967 req-ff1e5c36-2f2a-40a6-840c-f3dd818462e5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048704 Jun 25 16:13:11.566041 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 384/772] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:13:11.819070 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c627e3cf-c06d-421a-b14e-de7bdd11cf2d tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:11.819686 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c627e3cf-c06d-421a-b14e-de7bdd11cf2d tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:11.830992 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c627e3cf-c06d-421a-b14e-de7bdd11cf2d tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:11.832553 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c627e3cf-c06d-421a-b14e-de7bdd11cf2d tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:11.833540 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c627e3cf-c06d-421a-b14e-de7bdd11cf2d tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:11.834374 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c627e3cf-c06d-421a-b14e-de7bdd11cf2d tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:11.963633 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c627e3cf-c06d-421a-b14e-de7bdd11cf2d tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5bd682806c864805a3b410411839ca99', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9b1a552fc6cc43bb80f8a5f951bfcf80', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:11.977777 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c627e3cf-c06d-421a-b14e-de7bdd11cf2d tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 200 len: 1219 microversion: 2.1 time: 0.164057 Jun 25 16:13:11.985708 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 389/773] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:11 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 1219 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:13:12.998935 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-98ce6efa-e967-46f5-b5c5-92561636a39c tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:13.000290 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-98ce6efa-e967-46f5-b5c5-92561636a39c tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] [instance: affce264-2942-4aa8-850e-96642d84eff3] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:13.007507 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-98ce6efa-e967-46f5-b5c5-92561636a39c tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:13.008220 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-98ce6efa-e967-46f5-b5c5-92561636a39c tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:13.009084 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-98ce6efa-e967-46f5-b5c5-92561636a39c tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:13.009523 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-98ce6efa-e967-46f5-b5c5-92561636a39c tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:13.024592 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.wsgi [None req-98ce6efa-e967-46f5-b5c5-92561636a39c tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] HTTP exception thrown: Instance affce264-2942-4aa8-850e-96642d84eff3 could not be found. Jun 25 16:13:13.026237 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-98ce6efa-e967-46f5-b5c5-92561636a39c tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Request method failure captured: Jun 25 16:13:13.026237 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: request: GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 HTTP/1.1 Jun 25 16:13:13.026237 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept: application/json Jun 25 16:13:13.026237 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept-Encoding: identity Jun 25 16:13:13.026237 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Connection: close Jun 25 16:13:13.026237 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Length: 0 Jun 25 16:13:13.026237 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Type: application/json Jun 25 16:13:13.026237 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Host: 10.222.0.13 Jun 25 16:13:13.026237 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Openstack-System-Scope: None Jun 25 16:13:13.026237 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: User-Agent: python-urllib3/1.26.9 Jun 25 16:13:13.026237 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Auth-Token: gAAAAABitzLWzFKLT-pKmvWLH5yJPZ-iNQehaQh8pEjm_3mxh4poD0QNk1ECqn0G-ZvfQ1o1yZR2Zz6n5YE776Qdcez-KFTvFDaGp19xaGRE2m-FJhEhTTjsJmPXVWMDc8IvIIIAQCEYl4cftBsiZKh_7JaEhhvn6Aq8AVTwwLchWekMdD4O1iI Jun 25 16:13:13.026237 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Id: None Jun 25 16:13:13.026237 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Name: None Jun 25 16:13:13.026237 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Identity-Status: Confirmed Jun 25 16:13:13.026237 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Is-Admin-Project: True Jun 25 16:13:13.026237 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Id: default Jun 25 16:13:13.026237 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Name: Default Jun 25 16:13:13.026237 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Id: 9b1a552fc6cc43bb80f8a5f951bfcf80 Jun 25 16:13:13.026237 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Name: tempest-TestShelveInstance-246117046 Jun 25 16:13:13.026237 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Role: reader,member Jun 25 16:13:13.026237 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Roles: reader,member Jun 25 16:13:13.027852 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9b1a552fc6cc43bb80f8a5f951bfcf80"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9b1a552fc6cc43bb80f8a5f951bfcf80"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9b1a552fc6cc43bb80f8a5f951bfcf80", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9b1a552fc6cc43bb80f8a5f951bfcf80"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:13:13.027852 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant: tempest-TestShelveInstance-246117046 Jun 25 16:13:13.027852 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Id: 9b1a552fc6cc43bb80f8a5f951bfcf80 Jun 25 16:13:13.027852 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Name: tempest-TestShelveInstance-246117046 Jun 25 16:13:13.027852 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User: tempest-TestShelveInstance-246117046-project Jun 25 16:13:13.027852 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Id: default Jun 25 16:13:13.027852 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Name: Default Jun 25 16:13:13.027852 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Id: 5bd682806c864805a3b410411839ca99 Jun 25 16:13:13.027852 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Name: tempest-TestShelveInstance-246117046-project Jun 25 16:13:13.027852 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: method: > Jun 25 16:13:13.027852 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: exception: Instance affce264-2942-4aa8-850e-96642d84eff3 could not be found. Jun 25 16:13:13.027852 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: action_args: {'id': 'affce264-2942-4aa8-850e-96642d84eff3'} Jun 25 16:13:13.029103 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:13:13.029103 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:13:13.029103 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:13:13.029103 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:13:13.029103 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:13:13.029103 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:13:13.029103 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:13:13.029103 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:13:13.029103 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:13:13.029103 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:13:13.029103 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance affce264-2942-4aa8-850e-96642d84eff3 could not be found. Jun 25 16:13:13.029103 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:13:13.029103 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:13:13.029103 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:13:13.029103 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:13:13.029103 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:13:13.029103 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:13:13.029103 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:13:13.029103 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:13:13.029103 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:13:13.030956 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:13:13.030956 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 16:13:13.030956 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 16:13:13.030956 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:13:13.030956 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:13:13.030956 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:13:13.030956 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:13:13.030956 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance affce264-2942-4aa8-850e-96642d84eff3 could not be found. Jun 25 16:13:13.030956 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:13:13.030956 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:13:13.030956 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:13:13.030956 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:13:13.030956 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:13:13.030956 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:13:13.030956 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:13:13.030956 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:13:13.030956 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance affce264-2942-4aa8-850e-96642d84eff3 could not be found. Jun 25 16:13:13.030956 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:13:13.032347 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-98ce6efa-e967-46f5-b5c5-92561636a39c tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Returning 404 to user: Instance affce264-2942-4aa8-850e-96642d84eff3 could not be found. {{(pid=117794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:13:13.032347 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-98ce6efa-e967-46f5-b5c5-92561636a39c tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3" status: 404 len: 111 microversion: 2.1 time: 0.033548 Jun 25 16:13:13.032347 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 385/774] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:12 2022] GET /compute/v2.1/servers/affce264-2942-4aa8-850e-96642d84eff3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:13:13.316174 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-72b52a64-4c48-44f0-9034-8d2d3a8f920c tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] Calling method '.version_select at 0x7f65bb631f70>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:13.337675 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:13:13.361952 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-72b52a64-4c48-44f0-9034-8d2d3a8f920c tempest-TestShelveInstance-246117046 tempest-TestShelveInstance-246117046-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1809084523" status: 202 len: 0 microversion: 2.1 time: 0.050418 Jun 25 16:13:13.369676 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 390/775] 10.222.0.13 () {58 vars in 1253 bytes} [Sat Jun 25 16:13:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1809084523 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 16:13:22.391189 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-e37c1fb9-51ae-4417-af3e-caa2024f1c6b tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Action: 'create', calling method: .version_select at 0x7f65bb5174c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-38770479", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVEeYimVZb5/mHrK4T94MeN6Hd5sSCnHflzEUTwzE/DFH26ojD2BGw4xXkdPhGTjJIgqHxRMaB/z2WlbC1mQyofCHEc3/oLKzV9qtAkuWq1vW8TdS1HLd1XwzcuVSZd8w=="}} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:13:22.411012 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.quota [None req-e37c1fb9-51ae-4417-af3e-caa2024f1c6b tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Getting quotas for project c5bb30b042f3422faf43af82b27b37a5. Resources: {'key_pairs'} {{(pid=117794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:13:22.417132 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.quota [None req-e37c1fb9-51ae-4417-af3e-caa2024f1c6b tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Getting quotas for user 0ef599055aed42f3a97fb30bba553fb0 and project c5bb30b042f3422faf43af82b27b37a5. Resources: {'key_pairs'} {{(pid=117794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:13:22.447407 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-e37c1fb9-51ae-4417-af3e-caa2024f1c6b tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.362991 Jun 25 16:13:22.448013 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 386/776] 10.222.0.13 () {60 vars in 1158 bytes} [Sat Jun 25 16:13:22 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 16:13:39.004713 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:13:39.005449 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=2,nova_api:DELETE=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:13:39.009829 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c4ce1179-7411-4c39-8480-4e417a1f6fe1 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1328379955", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-38770479", "security_groups": [{"name": "tempest-secgroup-smoke-1054987293"}], "block_device_mapping_v2": [{"uuid": "e03c5494-1f63-4d89-8927-77d35f2d6b5d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4493f90c-02cf-4ced-9f9f-700abb5cb837"}]}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:13:39.135672 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-c4ce1179-7411-4c39-8480-4e417a1f6fe1 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] validate_networks() for [('4493f90c-02cf-4ced-9f9f-700abb5cb837', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 16:13:39.523060 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-c4ce1179-7411-4c39-8480-4e417a1f6fe1 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 16:13:39.523800 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-c4ce1179-7411-4c39-8480-4e417a1f6fe1 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 16:13:39.524575 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-c4ce1179-7411-4c39-8480-4e417a1f6fe1 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 16:13:39.525193 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-c4ce1179-7411-4c39-8480-4e417a1f6fe1 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 16:13:39.525867 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-c4ce1179-7411-4c39-8480-4e417a1f6fe1 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 16:13:39.537082 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c4ce1179-7411-4c39-8480-4e417a1f6fe1 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:39.537524 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c4ce1179-7411-4c39-8480-4e417a1f6fe1 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:39.538314 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c4ce1179-7411-4c39-8480-4e417a1f6fe1 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:39.538743 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c4ce1179-7411-4c39-8480-4e417a1f6fe1 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:39.555924 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-c4ce1179-7411-4c39-8480-4e417a1f6fe1 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Getting quotas for project c5bb30b042f3422faf43af82b27b37a5. Resources: {'ram', 'cores', 'instances'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:13:39.560284 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-c4ce1179-7411-4c39-8480-4e417a1f6fe1 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Getting quotas for user 0ef599055aed42f3a97fb30bba553fb0 and project c5bb30b042f3422faf43af82b27b37a5. Resources: {'ram', 'cores', 'instances'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:13:39.618787 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c4ce1179-7411-4c39-8480-4e417a1f6fe1 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 16:13:39.620957 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c4ce1179-7411-4c39-8480-4e417a1f6fe1 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 3193adb5-3665-405c-b68c-30023d88105d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e03c5494-1f63-4d89-8927-77d35f2d6b5d',volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 16:13:39.698471 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-6e898477-f6f6-4a0c-9e1d-3a49d6b4375f tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:39.699060 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-6e898477-f6f6-4a0c-9e1d-3a49d6b4375f tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:39.701192 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=15 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:13:39.701931 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell0:SELECT=4 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:13:39.702533 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=1 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:13:39.708639 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6e898477-f6f6-4a0c-9e1d-3a49d6b4375f tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:39.709092 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6e898477-f6f6-4a0c-9e1d-3a49d6b4375f tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:39.709923 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6e898477-f6f6-4a0c-9e1d-3a49d6b4375f tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:39.710362 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6e898477-f6f6-4a0c-9e1d-3a49d6b4375f tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:39.767229 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c4ce1179-7411-4c39-8480-4e417a1f6fe1 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.763764 Jun 25 16:13:39.768108 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 391/777] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Jun 25 16:13:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 16:13:39.778822 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-83c1c037-1b73-4ba5-81d0-ae58ee5ffdff tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:39.779633 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-83c1c037-1b73-4ba5-81d0-ae58ee5ffdff tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 3193adb5-3665-405c-b68c-30023d88105d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:39.801573 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.objects.instance [None req-6e898477-f6f6-4a0c-9e1d-3a49d6b4375f tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lazy-loading 'services' on Instance uuid d0460a39-cea4-4afc-92b3-091c5a768695 {{(pid=117794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 16:13:39.842540 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-83c1c037-1b73-4ba5-81d0-ae58ee5ffdff tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:39.849369 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-83c1c037-1b73-4ba5-81d0-ae58ee5ffdff tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d" status: 200 len: 1093 microversion: 2.1 time: 0.075332 Jun 25 16:13:39.861348 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 392/778] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:39 2022] GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d => generated 1093 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:13:39.886535 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-6e898477-f6f6-4a0c-9e1d-3a49d6b4375f tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695/os-volume_attachments/0d958027-2b03-4004-a2a4-50ac691f1019" status: 202 len: 0 microversion: 2.1 time: 0.192957 Jun 25 16:13:39.887651 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 387/779] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Jun 25 16:13:39 2022] DELETE /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695/os-volume_attachments/0d958027-2b03-4004-a2a4-50ac691f1019 => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 16:13:40.870102 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7b6162a5-7eec-40a9-aee6-83b5dafc7a23 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:40.870690 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7b6162a5-7eec-40a9-aee6-83b5dafc7a23 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 3193adb5-3665-405c-b68c-30023d88105d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:40.878249 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7b6162a5-7eec-40a9-aee6-83b5dafc7a23 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:40.878954 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7b6162a5-7eec-40a9-aee6-83b5dafc7a23 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:40.879845 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7b6162a5-7eec-40a9-aee6-83b5dafc7a23 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:40.880274 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7b6162a5-7eec-40a9-aee6-83b5dafc7a23 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:40.959354 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7b6162a5-7eec-40a9-aee6-83b5dafc7a23 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:40.974682 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7b6162a5-7eec-40a9-aee6-83b5dafc7a23 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d" status: 200 len: 1209 microversion: 2.1 time: 0.109257 Jun 25 16:13:40.985074 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 393/780] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:40 2022] GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d => generated 1209 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:13:41.023253 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-327684dc-faec-4911-818a-3138e92d75f0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:13:41.042847 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-327684dc-faec-4911-818a-3138e92d75f0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:41.043492 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-327684dc-faec-4911-818a-3138e92d75f0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:41.066855 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-327684dc-faec-4911-818a-3138e92d75f0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Going to try to stop instance {{(pid=117794) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 25 16:13:41.112708 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-327684dc-faec-4911-818a-3138e92d75f0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "POST /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695/action" status: 202 len: 0 microversion: 2.1 time: 0.097137 Jun 25 16:13:41.113664 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 388/781] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Jun 25 16:13:41 2022] POST /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 16:13:41.122702 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-22f3759b-8222-459c-893c-ff1c7341fb8c tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:41.123726 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-22f3759b-8222-459c-893c-ff1c7341fb8c tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:41.130637 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-22f3759b-8222-459c-893c-ff1c7341fb8c tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:41.131220 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-22f3759b-8222-459c-893c-ff1c7341fb8c tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:41.131947 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-22f3759b-8222-459c-893c-ff1c7341fb8c tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:41.132574 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-22f3759b-8222-459c-893c-ff1c7341fb8c tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:41.615253 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-22f3759b-8222-459c-893c-ff1c7341fb8c tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:41.624129 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-22f3759b-8222-459c-893c-ff1c7341fb8c tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1676 microversion: 2.1 time: 0.506006 Jun 25 16:13:41.624739 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 394/782] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:41 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1676 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:13:41.992651 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-b49881c4-752b-4e87-b37a-310c8fb2349b tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:41.993354 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-b49881c4-752b-4e87-b37a-310c8fb2349b tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 3193adb5-3665-405c-b68c-30023d88105d] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:42.002221 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b49881c4-752b-4e87-b37a-310c8fb2349b tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:42.002939 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b49881c4-752b-4e87-b37a-310c8fb2349b tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:42.003721 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b49881c4-752b-4e87-b37a-310c8fb2349b tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:42.004348 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b49881c4-752b-4e87-b37a-310c8fb2349b tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:42.243429 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-b49881c4-752b-4e87-b37a-310c8fb2349b tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:42.252146 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-b49881c4-752b-4e87-b37a-310c8fb2349b tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d" status: 200 len: 1265 microversion: 2.1 time: 0.263754 Jun 25 16:13:42.253027 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 389/783] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:41 2022] GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d => generated 1265 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:13:42.644212 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c62393fd-f981-4061-8821-cdcd6aff0129 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:42.646304 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c62393fd-f981-4061-8821-cdcd6aff0129 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:42.654776 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c62393fd-f981-4061-8821-cdcd6aff0129 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:42.655225 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c62393fd-f981-4061-8821-cdcd6aff0129 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:42.656207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c62393fd-f981-4061-8821-cdcd6aff0129 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:42.656675 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c62393fd-f981-4061-8821-cdcd6aff0129 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:42.704655 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-70c8cfe9-51df-4e71-9559-6a8461cc021e req-ab1f9f4d-0a56-4364-8e7f-d08cabc16d9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3193adb5-3665-405c-b68c-30023d88105d", "tag": "1a9f7280-53f6-4175-893c-f00a3bb1d1d4"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:13:42.714876 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-70c8cfe9-51df-4e71-9559-6a8461cc021e req-ab1f9f4d-0a56-4364-8e7f-d08cabc16d9e service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:42.715394 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-70c8cfe9-51df-4e71-9559-6a8461cc021e req-ab1f9f4d-0a56-4364-8e7f-d08cabc16d9e service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:42.731948 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-70c8cfe9-51df-4e71-9559-6a8461cc021e req-ab1f9f4d-0a56-4364-8e7f-d08cabc16d9e service nova] Creating event network-changed:1a9f7280-53f6-4175-893c-f00a3bb1d1d4 for instance 3193adb5-3665-405c-b68c-30023d88105d on hv-cinder-84762 Jun 25 16:13:42.741404 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-70c8cfe9-51df-4e71-9559-6a8461cc021e req-ab1f9f4d-0a56-4364-8e7f-d08cabc16d9e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041569 Jun 25 16:13:42.742623 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 390/784] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:13:42.891925 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c62393fd-f981-4061-8821-cdcd6aff0129 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:42.900174 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c62393fd-f981-4061-8821-cdcd6aff0129 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1676 microversion: 2.1 time: 0.262407 Jun 25 16:13:42.901086 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 395/785] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:42 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1676 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:13:43.274049 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-fa83f7b2-9607-4708-a842-e19cff1b789c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:43.274788 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-fa83f7b2-9607-4708-a842-e19cff1b789c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 3193adb5-3665-405c-b68c-30023d88105d] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:43.281858 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-fa83f7b2-9607-4708-a842-e19cff1b789c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:43.282275 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-fa83f7b2-9607-4708-a842-e19cff1b789c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:43.283072 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-fa83f7b2-9607-4708-a842-e19cff1b789c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:43.283489 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-fa83f7b2-9607-4708-a842-e19cff1b789c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:43.454150 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-fa83f7b2-9607-4708-a842-e19cff1b789c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:43.462203 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-fa83f7b2-9607-4708-a842-e19cff1b789c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d" status: 200 len: 1265 microversion: 2.1 time: 0.195607 Jun 25 16:13:43.462758 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 391/786] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:43 2022] GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:13:43.919384 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1f7b8514-013f-4a7c-afd1-254861114d4e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:43.919964 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1f7b8514-013f-4a7c-afd1-254861114d4e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:43.926552 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1f7b8514-013f-4a7c-afd1-254861114d4e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:43.927023 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1f7b8514-013f-4a7c-afd1-254861114d4e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:43.927772 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1f7b8514-013f-4a7c-afd1-254861114d4e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:43.928226 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1f7b8514-013f-4a7c-afd1-254861114d4e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:44.065278 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1f7b8514-013f-4a7c-afd1-254861114d4e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:44.076070 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1f7b8514-013f-4a7c-afd1-254861114d4e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1676 microversion: 2.1 time: 0.161265 Jun 25 16:13:44.076977 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 396/787] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:43 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1676 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:13:44.461865 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-6ce99833-ada6-4dc5-951b-1bbf8d210cfb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:44.463364 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-6ce99833-ada6-4dc5-951b-1bbf8d210cfb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:44.470005 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6ce99833-ada6-4dc5-951b-1bbf8d210cfb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:44.470495 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6ce99833-ada6-4dc5-951b-1bbf8d210cfb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:44.471263 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6ce99833-ada6-4dc5-951b-1bbf8d210cfb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:44.471698 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-6ce99833-ada6-4dc5-951b-1bbf8d210cfb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:44.479082 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a88b7ac5-f65a-469b-a143-59fc5ffe3f01 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:44.479768 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a88b7ac5-f65a-469b-a143-59fc5ffe3f01 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 3193adb5-3665-405c-b68c-30023d88105d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:44.486265 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a88b7ac5-f65a-469b-a143-59fc5ffe3f01 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:44.486797 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a88b7ac5-f65a-469b-a143-59fc5ffe3f01 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:44.487640 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a88b7ac5-f65a-469b-a143-59fc5ffe3f01 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:44.488134 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a88b7ac5-f65a-469b-a143-59fc5ffe3f01 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:44.500520 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-6ce99833-ada6-4dc5-951b-1bbf8d210cfb tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042654 Jun 25 16:13:44.501091 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 392/788] 10.222.0.13 () {60 vars in 1342 bytes} [Sat Jun 25 16:13:44 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:13:44.559999 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-8a6cac85-43fd-4f6f-bbe0-b3e33a3af45e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:44.560515 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-8a6cac85-43fd-4f6f-bbe0-b3e33a3af45e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:44.566733 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8a6cac85-43fd-4f6f-bbe0-b3e33a3af45e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:44.567205 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8a6cac85-43fd-4f6f-bbe0-b3e33a3af45e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:44.568015 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8a6cac85-43fd-4f6f-bbe0-b3e33a3af45e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:44.568481 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8a6cac85-43fd-4f6f-bbe0-b3e33a3af45e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:44.597327 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-8a6cac85-43fd-4f6f-bbe0-b3e33a3af45e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Going to try to terminate instance {{(pid=117794) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 16:13:44.619771 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a88b7ac5-f65a-469b-a143-59fc5ffe3f01 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:44.628501 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a88b7ac5-f65a-469b-a143-59fc5ffe3f01 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d" status: 200 len: 1265 microversion: 2.1 time: 0.153247 Jun 25 16:13:44.629077 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 397/789] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:44 2022] GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:13:44.676833 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-8a6cac85-43fd-4f6f-bbe0-b3e33a3af45e tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "DELETE /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 204 len: 0 microversion: 2.20 time: 0.120731 Jun 25 16:13:44.677391 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 393/790] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Jun 25 16:13:44 2022] DELETE /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 25 16:13:44.686880 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3030c750-e0dd-4eb9-acfa-62bc7fa7d9c9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:44.687484 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3030c750-e0dd-4eb9-acfa-62bc7fa7d9c9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:44.693561 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3030c750-e0dd-4eb9-acfa-62bc7fa7d9c9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:44.694014 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3030c750-e0dd-4eb9-acfa-62bc7fa7d9c9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:44.694783 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3030c750-e0dd-4eb9-acfa-62bc7fa7d9c9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:44.695226 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3030c750-e0dd-4eb9-acfa-62bc7fa7d9c9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:44.831403 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3030c750-e0dd-4eb9-acfa-62bc7fa7d9c9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:44.841718 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3030c750-e0dd-4eb9-acfa-62bc7fa7d9c9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:44.843241 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3030c750-e0dd-4eb9-acfa-62bc7fa7d9c9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:44.844436 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3030c750-e0dd-4eb9-acfa-62bc7fa7d9c9 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1724 microversion: 2.20 time: 0.162254 Jun 25 16:13:44.845004 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 398/791] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:13:44 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:13:45.099430 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-3c8b4306-5e62-41e4-822f-a489c73d7b53 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:45.100883 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-3c8b4306-5e62-41e4-822f-a489c73d7b53 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:45.109469 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3c8b4306-5e62-41e4-822f-a489c73d7b53 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:45.109920 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3c8b4306-5e62-41e4-822f-a489c73d7b53 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:45.110715 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3c8b4306-5e62-41e4-822f-a489c73d7b53 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:45.111152 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3c8b4306-5e62-41e4-822f-a489c73d7b53 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:45.263517 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-3c8b4306-5e62-41e4-822f-a489c73d7b53 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:45.271824 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-3c8b4306-5e62-41e4-822f-a489c73d7b53 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1676 microversion: 2.1 time: 0.179713 Jun 25 16:13:45.272393 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 394/792] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:45 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1676 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:13:45.650205 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9a8bba1b-6d82-41cc-a975-695178053cc3 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:45.651332 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9a8bba1b-6d82-41cc-a975-695178053cc3 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 3193adb5-3665-405c-b68c-30023d88105d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:45.659500 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9a8bba1b-6d82-41cc-a975-695178053cc3 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:45.659954 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9a8bba1b-6d82-41cc-a975-695178053cc3 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:45.660762 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9a8bba1b-6d82-41cc-a975-695178053cc3 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:45.661194 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9a8bba1b-6d82-41cc-a975-695178053cc3 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:45.806908 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9a8bba1b-6d82-41cc-a975-695178053cc3 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:45.817848 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9a8bba1b-6d82-41cc-a975-695178053cc3 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d" status: 200 len: 1265 microversion: 2.1 time: 0.173935 Jun 25 16:13:45.818506 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 399/793] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:45 2022] GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:13:45.866524 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-afe9b1a7-7451-4c6a-979c-6548bf0ce929 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:45.867395 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-afe9b1a7-7451-4c6a-979c-6548bf0ce929 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:45.879130 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-afe9b1a7-7451-4c6a-979c-6548bf0ce929 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:45.879872 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-afe9b1a7-7451-4c6a-979c-6548bf0ce929 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:45.881181 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-afe9b1a7-7451-4c6a-979c-6548bf0ce929 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:45.881885 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-afe9b1a7-7451-4c6a-979c-6548bf0ce929 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:46.072978 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-afe9b1a7-7451-4c6a-979c-6548bf0ce929 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:46.081677 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-afe9b1a7-7451-4c6a-979c-6548bf0ce929 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:46.083181 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-afe9b1a7-7451-4c6a-979c-6548bf0ce929 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:46.084337 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-afe9b1a7-7451-4c6a-979c-6548bf0ce929 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1724 microversion: 2.20 time: 0.224938 Jun 25 16:13:46.084955 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 395/794] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:13:45 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:13:46.294997 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7550221e-8092-4c1f-8ebc-9d112f904dab tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:46.295516 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7550221e-8092-4c1f-8ebc-9d112f904dab tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:46.301911 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7550221e-8092-4c1f-8ebc-9d112f904dab tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:46.302382 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7550221e-8092-4c1f-8ebc-9d112f904dab tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:46.303148 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7550221e-8092-4c1f-8ebc-9d112f904dab tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:46.303577 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7550221e-8092-4c1f-8ebc-9d112f904dab tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:46.522829 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7550221e-8092-4c1f-8ebc-9d112f904dab tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:46.532841 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7550221e-8092-4c1f-8ebc-9d112f904dab tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1676 microversion: 2.1 time: 0.241933 Jun 25 16:13:46.533454 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 400/795] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:46 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1676 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:13:46.835584 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-80c4e271-b2a7-4ef9-a34b-be6b3dbf9598 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:46.836270 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-80c4e271-b2a7-4ef9-a34b-be6b3dbf9598 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 3193adb5-3665-405c-b68c-30023d88105d] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:46.844624 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-80c4e271-b2a7-4ef9-a34b-be6b3dbf9598 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:46.845205 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-80c4e271-b2a7-4ef9-a34b-be6b3dbf9598 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:46.845994 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-80c4e271-b2a7-4ef9-a34b-be6b3dbf9598 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:46.846467 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-80c4e271-b2a7-4ef9-a34b-be6b3dbf9598 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:46.975759 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-3fd1fa0a-c86a-4b81-9800-93491b125a93 req-af7bca1e-0d38-48f0-87a2-fd502a877fa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "749fc9b1-a969-425d-b2e4-a88b63a45ffe", "name": "network-vif-deleted", "tag": "faf6b184-57b1-4bce-bc06-d6f249c9b017"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:13:46.998373 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-3fd1fa0a-c86a-4b81-9800-93491b125a93 req-af7bca1e-0d38-48f0-87a2-fd502a877fa9 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:46.999305 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-3fd1fa0a-c86a-4b81-9800-93491b125a93 req-af7bca1e-0d38-48f0-87a2-fd502a877fa9 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:47.032978 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-3fd1fa0a-c86a-4b81-9800-93491b125a93 req-af7bca1e-0d38-48f0-87a2-fd502a877fa9 service nova] Creating event network-vif-deleted:faf6b184-57b1-4bce-bc06-d6f249c9b017 for instance 749fc9b1-a969-425d-b2e4-a88b63a45ffe on hv-cinder-84762 Jun 25 16:13:47.041734 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-3fd1fa0a-c86a-4b81-9800-93491b125a93 req-af7bca1e-0d38-48f0-87a2-fd502a877fa9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075330 Jun 25 16:13:47.042677 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 401/796] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:13:47.067669 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-80c4e271-b2a7-4ef9-a34b-be6b3dbf9598 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:47.077226 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-80c4e271-b2a7-4ef9-a34b-be6b3dbf9598 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d" status: 200 len: 1265 microversion: 2.1 time: 0.245600 Jun 25 16:13:47.078445 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 396/797] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:46 2022] GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:13:47.107138 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ace336ad-6c25-44b1-90cd-e2bae2aa3d34 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:47.107779 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ace336ad-6c25-44b1-90cd-e2bae2aa3d34 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:47.115581 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ace336ad-6c25-44b1-90cd-e2bae2aa3d34 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:47.116028 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ace336ad-6c25-44b1-90cd-e2bae2aa3d34 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:47.117171 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ace336ad-6c25-44b1-90cd-e2bae2aa3d34 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:47.117600 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ace336ad-6c25-44b1-90cd-e2bae2aa3d34 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:47.158036 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ace336ad-6c25-44b1-90cd-e2bae2aa3d34 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:47.158744 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ace336ad-6c25-44b1-90cd-e2bae2aa3d34 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:47.159200 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-ace336ad-6c25-44b1-90cd-e2bae2aa3d34 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lazy-loading 'fault' on Instance uuid 749fc9b1-a969-425d-b2e4-a88b63a45ffe {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 16:13:47.205621 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ace336ad-6c25-44b1-90cd-e2bae2aa3d34 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:47.215040 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ace336ad-6c25-44b1-90cd-e2bae2aa3d34 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:47.216916 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ace336ad-6c25-44b1-90cd-e2bae2aa3d34 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '744eb9d4e7084b7e9cae36d5de67f0f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0da9a82039c24056beec4b61f533eaa2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:47.218073 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ace336ad-6c25-44b1-90cd-e2bae2aa3d34 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 200 len: 1371 microversion: 2.20 time: 0.118767 Jun 25 16:13:47.218635 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 402/798] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:13:47 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 1371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 25 16:13:47.550613 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-00d2c187-b191-4c39-a951-301ee4d104c2 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:47.551281 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-00d2c187-b191-4c39-a951-301ee4d104c2 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:47.559060 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-00d2c187-b191-4c39-a951-301ee4d104c2 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:47.561187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-00d2c187-b191-4c39-a951-301ee4d104c2 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:47.562768 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-00d2c187-b191-4c39-a951-301ee4d104c2 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:47.563214 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-00d2c187-b191-4c39-a951-301ee4d104c2 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:47.731808 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-00d2c187-b191-4c39-a951-301ee4d104c2 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:47.741871 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-00d2c187-b191-4c39-a951-301ee4d104c2 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1676 microversion: 2.1 time: 0.195402 Jun 25 16:13:47.742454 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 397/799] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:47 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1676 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:13:48.094072 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d3a4f877-19c6-4609-87ea-7c4271426161 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:48.094690 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d3a4f877-19c6-4609-87ea-7c4271426161 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 3193adb5-3665-405c-b68c-30023d88105d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:48.102112 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d3a4f877-19c6-4609-87ea-7c4271426161 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:48.102587 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d3a4f877-19c6-4609-87ea-7c4271426161 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:48.103355 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d3a4f877-19c6-4609-87ea-7c4271426161 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:48.103756 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d3a4f877-19c6-4609-87ea-7c4271426161 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:48.236980 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-8f345919-c761-42d4-ab04-278c4e561be8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:48.238626 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-8f345919-c761-42d4-ab04-278c4e561be8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:48.245519 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8f345919-c761-42d4-ab04-278c4e561be8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:48.246240 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8f345919-c761-42d4-ab04-278c4e561be8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:48.247023 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8f345919-c761-42d4-ab04-278c4e561be8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:48.247443 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8f345919-c761-42d4-ab04-278c4e561be8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:48.250641 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d3a4f877-19c6-4609-87ea-7c4271426161 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:48.259502 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d3a4f877-19c6-4609-87ea-7c4271426161 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d" status: 200 len: 1265 microversion: 2.1 time: 0.169430 Jun 25 16:13:48.261191 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 403/800] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:48 2022] GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:13:48.262989 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.wsgi [None req-8f345919-c761-42d4-ab04-278c4e561be8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] HTTP exception thrown: Instance 749fc9b1-a969-425d-b2e4-a88b63a45ffe could not be found. Jun 25 16:13:48.265006 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-8f345919-c761-42d4-ab04-278c4e561be8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Request method failure captured: Jun 25 16:13:48.265006 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: request: GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe HTTP/1.1 Jun 25 16:13:48.265006 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept: application/json Jun 25 16:13:48.265006 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept-Encoding: identity Jun 25 16:13:48.265006 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Connection: close Jun 25 16:13:48.265006 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Length: 0 Jun 25 16:13:48.265006 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Type: application/json Jun 25 16:13:48.265006 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Host: 10.222.0.13 Jun 25 16:13:48.265006 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Openstack-System-Scope: None Jun 25 16:13:48.265006 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: User-Agent: python-urllib3/1.26.9 Jun 25 16:13:48.265006 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Auth-Token: gAAAAABitzLPXaDcj4dKOPfgjjri_C1-SyRZTd_fhOKnzEyt4fLtf90pxk0LWGKMcZbbirj9taIcsoY2m9qLNoVV7QiH1vcCDpXJrf5HBr6Fjx1ws7rNRA3jbH6Qu15vUt34XH0i7OdnrurR7MupWyI759xgN8WUUKJ4adEv-bx7R7lzXeuZ-lk Jun 25 16:13:48.265006 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Id: None Jun 25 16:13:48.265006 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Name: None Jun 25 16:13:48.265006 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Identity-Status: Confirmed Jun 25 16:13:48.265006 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Is-Admin-Project: True Jun 25 16:13:48.265006 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Openstack-Nova-Api-Version: 2.20 Jun 25 16:13:48.265006 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Id: default Jun 25 16:13:48.265006 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Name: Default Jun 25 16:13:48.265006 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Id: 0da9a82039c24056beec4b61f533eaa2 Jun 25 16:13:48.265006 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1604464304 Jun 25 16:13:48.265006 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Role: reader,member Jun 25 16:13:48.265006 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Roles: reader,member Jun 25 16:13:48.266460 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0da9a82039c24056beec4b61f533eaa2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0da9a82039c24056beec4b61f533eaa2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0da9a82039c24056beec4b61f533eaa2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0da9a82039c24056beec4b61f533eaa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:13:48.266460 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1604464304 Jun 25 16:13:48.266460 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Id: 0da9a82039c24056beec4b61f533eaa2 Jun 25 16:13:48.266460 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1604464304 Jun 25 16:13:48.266460 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User: tempest-AttachVolumeShelveTestJSON-1604464304-project Jun 25 16:13:48.266460 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Id: default Jun 25 16:13:48.266460 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Name: Default Jun 25 16:13:48.266460 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Id: 744eb9d4e7084b7e9cae36d5de67f0f0 Jun 25 16:13:48.266460 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1604464304-project Jun 25 16:13:48.266460 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: method: > Jun 25 16:13:48.266460 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: exception: Instance 749fc9b1-a969-425d-b2e4-a88b63a45ffe could not be found. Jun 25 16:13:48.266460 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: action_args: {'id': '749fc9b1-a969-425d-b2e4-a88b63a45ffe'} Jun 25 16:13:48.267225 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:13:48.267225 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:13:48.267225 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:13:48.267225 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:13:48.267225 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:13:48.267225 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:13:48.267225 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:13:48.267225 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:13:48.267225 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:13:48.267225 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:13:48.267225 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 749fc9b1-a969-425d-b2e4-a88b63a45ffe could not be found. Jun 25 16:13:48.267225 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:13:48.267225 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:13:48.267225 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:13:48.267225 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:13:48.267225 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:13:48.267225 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:13:48.267225 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:13:48.267225 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:13:48.267225 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:13:48.268641 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:13:48.268641 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 16:13:48.268641 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 16:13:48.268641 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:13:48.268641 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:13:48.268641 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:13:48.268641 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:13:48.268641 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 749fc9b1-a969-425d-b2e4-a88b63a45ffe could not be found. Jun 25 16:13:48.268641 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:13:48.268641 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:13:48.268641 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:13:48.268641 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:13:48.268641 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:13:48.268641 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:13:48.268641 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:13:48.268641 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:13:48.268641 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 749fc9b1-a969-425d-b2e4-a88b63a45ffe could not be found. Jun 25 16:13:48.268641 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:13:48.269780 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-8f345919-c761-42d4-ab04-278c4e561be8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Returning 404 to user: Instance 749fc9b1-a969-425d-b2e4-a88b63a45ffe could not be found. {{(pid=117794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:13:48.269780 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-8f345919-c761-42d4-ab04-278c4e561be8 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 404 len: 111 microversion: 2.20 time: 0.033611 Jun 25 16:13:48.270425 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 398/801] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:13:48 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 25 16:13:48.275275 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-645722ae-85ba-4e7d-8558-4aa36fd20b6b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '.version_select at 0x7f65bb64e0d0>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:48.295732 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-645722ae-85ba-4e7d-8558-4aa36fd20b6b tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-991161026" status: 204 len: 0 microversion: 2.20 time: 0.024164 Jun 25 16:13:48.296545 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 404/802] 10.222.0.13 () {60 vars in 1258 bytes} [Sat Jun 25 16:13:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-991161026 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 25 16:13:48.759479 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-d5744fa0-ae5b-4e11-a5e8-81d58a80e7ed tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:48.760037 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-d5744fa0-ae5b-4e11-a5e8-81d58a80e7ed tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:48.767369 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d5744fa0-ae5b-4e11-a5e8-81d58a80e7ed tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:48.767872 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d5744fa0-ae5b-4e11-a5e8-81d58a80e7ed tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:48.768697 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d5744fa0-ae5b-4e11-a5e8-81d58a80e7ed tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:48.769114 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d5744fa0-ae5b-4e11-a5e8-81d58a80e7ed tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:48.985350 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d5744fa0-ae5b-4e11-a5e8-81d58a80e7ed tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:48.994292 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-d5744fa0-ae5b-4e11-a5e8-81d58a80e7ed tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1676 microversion: 2.1 time: 0.238873 Jun 25 16:13:48.994889 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 399/803] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:48 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1676 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:13:49.278088 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b68ffb69-f253-48ad-9e5f-8ab73f6cbc98 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:49.278732 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b68ffb69-f253-48ad-9e5f-8ab73f6cbc98 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 3193adb5-3665-405c-b68c-30023d88105d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:49.285475 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b68ffb69-f253-48ad-9e5f-8ab73f6cbc98 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:49.285928 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b68ffb69-f253-48ad-9e5f-8ab73f6cbc98 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:49.286723 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b68ffb69-f253-48ad-9e5f-8ab73f6cbc98 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:49.287159 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b68ffb69-f253-48ad-9e5f-8ab73f6cbc98 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:49.426841 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b68ffb69-f253-48ad-9e5f-8ab73f6cbc98 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:49.435194 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b68ffb69-f253-48ad-9e5f-8ab73f6cbc98 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d" status: 200 len: 1265 microversion: 2.1 time: 0.161264 Jun 25 16:13:49.435736 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 405/804] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:49 2022] GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:13:50.013165 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-bf176974-117a-45a0-b823-6df8efb4fe4f tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:50.013729 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-bf176974-117a-45a0-b823-6df8efb4fe4f tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:50.021064 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-bf176974-117a-45a0-b823-6df8efb4fe4f tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:50.021522 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-bf176974-117a-45a0-b823-6df8efb4fe4f tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:50.022293 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-bf176974-117a-45a0-b823-6df8efb4fe4f tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:50.022738 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-bf176974-117a-45a0-b823-6df8efb4fe4f tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:50.148233 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-cc38b3ee-80a9-4f21-a48f-e682e519b259 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:50.148864 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-cc38b3ee-80a9-4f21-a48f-e682e519b259 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:50.150878 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:13:50.151768 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=8 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:13:50.158701 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cc38b3ee-80a9-4f21-a48f-e682e519b259 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:50.159153 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cc38b3ee-80a9-4f21-a48f-e682e519b259 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:50.159961 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cc38b3ee-80a9-4f21-a48f-e682e519b259 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:50.160516 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cc38b3ee-80a9-4f21-a48f-e682e519b259 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:50.174612 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-bf176974-117a-45a0-b823-6df8efb4fe4f tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:50.175573 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-cc38b3ee-80a9-4f21-a48f-e682e519b259 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] HTTP exception thrown: Instance 749fc9b1-a969-425d-b2e4-a88b63a45ffe could not be found. Jun 25 16:13:50.177476 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-cc38b3ee-80a9-4f21-a48f-e682e519b259 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Request method failure captured: Jun 25 16:13:50.177476 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: request: DELETE /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe HTTP/1.1 Jun 25 16:13:50.177476 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept: application/json Jun 25 16:13:50.177476 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jun 25 16:13:50.177476 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Connection: close Jun 25 16:13:50.177476 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jun 25 16:13:50.177476 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jun 25 16:13:50.177476 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Host: 10.222.0.13 Jun 25 16:13:50.177476 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jun 25 16:13:50.177476 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jun 25 16:13:50.177476 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABitzLPXaDcj4dKOPfgjjri_C1-SyRZTd_fhOKnzEyt4fLtf90pxk0LWGKMcZbbirj9taIcsoY2m9qLNoVV7QiH1vcCDpXJrf5HBr6Fjx1ws7rNRA3jbH6Qu15vUt34XH0i7OdnrurR7MupWyI759xgN8WUUKJ4adEv-bx7R7lzXeuZ-lk Jun 25 16:13:50.177476 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jun 25 16:13:50.177476 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jun 25 16:13:50.177476 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jun 25 16:13:50.177476 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jun 25 16:13:50.177476 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Openstack-Nova-Api-Version: 2.20 Jun 25 16:13:50.177476 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jun 25 16:13:50.177476 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jun 25 16:13:50.177476 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Id: 0da9a82039c24056beec4b61f533eaa2 Jun 25 16:13:50.177476 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1604464304 Jun 25 16:13:50.177476 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Role: reader,member Jun 25 16:13:50.177476 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Jun 25 16:13:50.178840 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0da9a82039c24056beec4b61f533eaa2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0da9a82039c24056beec4b61f533eaa2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0da9a82039c24056beec4b61f533eaa2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0da9a82039c24056beec4b61f533eaa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:13:50.178840 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1604464304 Jun 25 16:13:50.178840 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 0da9a82039c24056beec4b61f533eaa2 Jun 25 16:13:50.178840 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1604464304 Jun 25 16:13:50.178840 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeShelveTestJSON-1604464304-project Jun 25 16:13:50.178840 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jun 25 16:13:50.178840 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jun 25 16:13:50.178840 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Id: 744eb9d4e7084b7e9cae36d5de67f0f0 Jun 25 16:13:50.178840 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1604464304-project Jun 25 16:13:50.178840 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: method: > Jun 25 16:13:50.178840 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: exception: Instance 749fc9b1-a969-425d-b2e4-a88b63a45ffe could not be found. Jun 25 16:13:50.178840 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: action_args: {'id': '749fc9b1-a969-425d-b2e4-a88b63a45ffe'} Jun 25 16:13:50.179923 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:13:50.179923 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:13:50.179923 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:13:50.179923 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:13:50.179923 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:13:50.179923 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:13:50.179923 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:13:50.179923 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:13:50.179923 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:13:50.179923 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:13:50.179923 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 749fc9b1-a969-425d-b2e4-a88b63a45ffe could not be found. Jun 25 16:13:50.179923 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:13:50.179923 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:13:50.179923 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:13:50.179923 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:13:50.179923 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:13:50.179923 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:13:50.179923 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:13:50.179923 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:13:50.179923 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:13:50.181323 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:13:50.181323 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 16:13:50.181323 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 16:13:50.181323 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 16:13:50.181323 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 16:13:50.181323 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:13:50.181323 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:13:50.181323 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:13:50.181323 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:13:50.181323 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 749fc9b1-a969-425d-b2e4-a88b63a45ffe could not be found. Jun 25 16:13:50.181323 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:13:50.181323 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:13:50.181323 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:13:50.181323 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:13:50.181323 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:13:50.181323 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:13:50.181323 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:13:50.181323 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:13:50.181323 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 749fc9b1-a969-425d-b2e4-a88b63a45ffe could not be found. Jun 25 16:13:50.181323 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:13:50.183090 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-cc38b3ee-80a9-4f21-a48f-e682e519b259 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Returning 404 to user: Instance 749fc9b1-a969-425d-b2e4-a88b63a45ffe could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:13:50.183090 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-cc38b3ee-80a9-4f21-a48f-e682e519b259 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "DELETE /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 404 len: 111 microversion: 2.20 time: 0.034582 Jun 25 16:13:50.183090 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 406/805] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Jun 25 16:13:50 2022] DELETE /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 25 16:13:50.184161 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-bf176974-117a-45a0-b823-6df8efb4fe4f tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1676 microversion: 2.1 time: 0.175073 Jun 25 16:13:50.184998 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 400/806] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:50 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1676 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:13:50.188042 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-53eda85a-072f-4299-970f-fd3a9f1d8893 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:50.188678 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-53eda85a-072f-4299-970f-fd3a9f1d8893 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: 749fc9b1-a969-425d-b2e4-a88b63a45ffe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:50.194974 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-53eda85a-072f-4299-970f-fd3a9f1d8893 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:50.195423 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-53eda85a-072f-4299-970f-fd3a9f1d8893 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:50.196214 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-53eda85a-072f-4299-970f-fd3a9f1d8893 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:50.196680 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-53eda85a-072f-4299-970f-fd3a9f1d8893 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:50.211162 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-53eda85a-072f-4299-970f-fd3a9f1d8893 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] HTTP exception thrown: Instance 749fc9b1-a969-425d-b2e4-a88b63a45ffe could not be found. Jun 25 16:13:50.212739 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-53eda85a-072f-4299-970f-fd3a9f1d8893 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Request method failure captured: Jun 25 16:13:50.212739 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe HTTP/1.1 Jun 25 16:13:50.212739 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept: application/json Jun 25 16:13:50.212739 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jun 25 16:13:50.212739 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Connection: close Jun 25 16:13:50.212739 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jun 25 16:13:50.212739 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jun 25 16:13:50.212739 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Host: 10.222.0.13 Jun 25 16:13:50.212739 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jun 25 16:13:50.212739 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jun 25 16:13:50.212739 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABitzLPXaDcj4dKOPfgjjri_C1-SyRZTd_fhOKnzEyt4fLtf90pxk0LWGKMcZbbirj9taIcsoY2m9qLNoVV7QiH1vcCDpXJrf5HBr6Fjx1ws7rNRA3jbH6Qu15vUt34XH0i7OdnrurR7MupWyI759xgN8WUUKJ4adEv-bx7R7lzXeuZ-lk Jun 25 16:13:50.212739 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jun 25 16:13:50.212739 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jun 25 16:13:50.212739 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jun 25 16:13:50.212739 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jun 25 16:13:50.212739 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Openstack-Nova-Api-Version: 2.20 Jun 25 16:13:50.212739 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jun 25 16:13:50.212739 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jun 25 16:13:50.212739 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Id: 0da9a82039c24056beec4b61f533eaa2 Jun 25 16:13:50.212739 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1604464304 Jun 25 16:13:50.212739 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Role: reader,member Jun 25 16:13:50.212739 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Jun 25 16:13:50.214312 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0da9a82039c24056beec4b61f533eaa2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0da9a82039c24056beec4b61f533eaa2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0da9a82039c24056beec4b61f533eaa2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0da9a82039c24056beec4b61f533eaa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:13:50.214312 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1604464304 Jun 25 16:13:50.214312 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 0da9a82039c24056beec4b61f533eaa2 Jun 25 16:13:50.214312 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1604464304 Jun 25 16:13:50.214312 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeShelveTestJSON-1604464304-project Jun 25 16:13:50.214312 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jun 25 16:13:50.214312 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jun 25 16:13:50.214312 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Id: 744eb9d4e7084b7e9cae36d5de67f0f0 Jun 25 16:13:50.214312 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1604464304-project Jun 25 16:13:50.214312 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: method: > Jun 25 16:13:50.214312 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: exception: Instance 749fc9b1-a969-425d-b2e4-a88b63a45ffe could not be found. Jun 25 16:13:50.214312 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: action_args: {'id': '749fc9b1-a969-425d-b2e4-a88b63a45ffe'} Jun 25 16:13:50.215084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:13:50.215084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:13:50.215084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:13:50.215084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:13:50.215084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:13:50.215084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:13:50.215084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:13:50.215084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:13:50.215084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:13:50.215084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:13:50.215084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 749fc9b1-a969-425d-b2e4-a88b63a45ffe could not be found. Jun 25 16:13:50.215084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:13:50.215084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:13:50.215084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:13:50.215084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:13:50.215084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:13:50.215084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:13:50.215084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:13:50.215084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:13:50.215084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:13:50.216272 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:13:50.216272 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 16:13:50.216272 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 16:13:50.216272 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:13:50.216272 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:13:50.216272 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:13:50.216272 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:13:50.216272 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 749fc9b1-a969-425d-b2e4-a88b63a45ffe could not be found. Jun 25 16:13:50.216272 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:13:50.216272 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:13:50.216272 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:13:50.216272 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:13:50.216272 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:13:50.216272 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:13:50.216272 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:13:50.216272 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:13:50.216272 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 749fc9b1-a969-425d-b2e4-a88b63a45ffe could not be found. Jun 25 16:13:50.216272 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:13:50.217402 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-53eda85a-072f-4299-970f-fd3a9f1d8893 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Returning 404 to user: Instance 749fc9b1-a969-425d-b2e4-a88b63a45ffe could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:13:50.217402 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-53eda85a-072f-4299-970f-fd3a9f1d8893 tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe" status: 404 len: 111 microversion: 2.20 time: 0.030233 Jun 25 16:13:50.217402 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 407/807] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:13:50 2022] GET /compute/v2.1/servers/749fc9b1-a969-425d-b2e4-a88b63a45ffe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 25 16:13:50.453580 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-662bc873-6d63-4250-a0b5-d8e968cfe2d3 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:50.454274 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-662bc873-6d63-4250-a0b5-d8e968cfe2d3 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 3193adb5-3665-405c-b68c-30023d88105d] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:50.461749 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-662bc873-6d63-4250-a0b5-d8e968cfe2d3 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:50.462197 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-662bc873-6d63-4250-a0b5-d8e968cfe2d3 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:50.463031 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-662bc873-6d63-4250-a0b5-d8e968cfe2d3 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:50.463470 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-662bc873-6d63-4250-a0b5-d8e968cfe2d3 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:50.486502 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:13:50.612365 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-662bc873-6d63-4250-a0b5-d8e968cfe2d3 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:50.622910 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-662bc873-6d63-4250-a0b5-d8e968cfe2d3 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d" status: 200 len: 1265 microversion: 2.1 time: 0.173978 Jun 25 16:13:50.623478 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 401/808] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:50 2022] GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:13:51.204008 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-05ee3681-b194-497e-99e2-987b03ed5924 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:51.204648 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-05ee3681-b194-497e-99e2-987b03ed5924 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:51.211594 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-05ee3681-b194-497e-99e2-987b03ed5924 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:51.212124 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-05ee3681-b194-497e-99e2-987b03ed5924 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:51.212850 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-05ee3681-b194-497e-99e2-987b03ed5924 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:51.213281 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-05ee3681-b194-497e-99e2-987b03ed5924 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:51.347981 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-05ee3681-b194-497e-99e2-987b03ed5924 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:51.356628 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-05ee3681-b194-497e-99e2-987b03ed5924 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1676 microversion: 2.1 time: 0.156565 Jun 25 16:13:51.357413 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 408/809] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:51 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:13:51.358394 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-5bba4496-550b-4a61-aca2-97673257d42f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:51.358906 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-5bba4496-550b-4a61-aca2-97673257d42f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:51.365542 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5bba4496-550b-4a61-aca2-97673257d42f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:51.366123 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5bba4496-550b-4a61-aca2-97673257d42f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:51.366976 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5bba4496-550b-4a61-aca2-97673257d42f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:51.367417 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5bba4496-550b-4a61-aca2-97673257d42f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:51.381761 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.wsgi [None req-5bba4496-550b-4a61-aca2-97673257d42f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] HTTP exception thrown: Instance e6ae5a58-db83-401e-a158-ebf0981e84ec could not be found. Jun 25 16:13:51.383333 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-5bba4496-550b-4a61-aca2-97673257d42f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Request method failure captured: Jun 25 16:13:51.383333 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: request: DELETE /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec HTTP/1.1 Jun 25 16:13:51.383333 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept: application/json Jun 25 16:13:51.383333 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept-Encoding: identity Jun 25 16:13:51.383333 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Connection: close Jun 25 16:13:51.383333 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Length: 0 Jun 25 16:13:51.383333 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Type: application/json Jun 25 16:13:51.383333 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Host: 10.222.0.13 Jun 25 16:13:51.383333 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Openstack-System-Scope: None Jun 25 16:13:51.383333 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: User-Agent: python-urllib3/1.26.9 Jun 25 16:13:51.383333 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Auth-Token: gAAAAABitzLPXaDcj4dKOPfgjjri_C1-SyRZTd_fhOKnzEyt4fLtf90pxk0LWGKMcZbbirj9taIcsoY2m9qLNoVV7QiH1vcCDpXJrf5HBr6Fjx1ws7rNRA3jbH6Qu15vUt34XH0i7OdnrurR7MupWyI759xgN8WUUKJ4adEv-bx7R7lzXeuZ-lk Jun 25 16:13:51.383333 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Id: None Jun 25 16:13:51.383333 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Name: None Jun 25 16:13:51.383333 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Identity-Status: Confirmed Jun 25 16:13:51.383333 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Is-Admin-Project: True Jun 25 16:13:51.383333 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Openstack-Nova-Api-Version: 2.20 Jun 25 16:13:51.383333 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Id: default Jun 25 16:13:51.383333 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Name: Default Jun 25 16:13:51.383333 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Id: 0da9a82039c24056beec4b61f533eaa2 Jun 25 16:13:51.383333 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1604464304 Jun 25 16:13:51.383333 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Role: reader,member Jun 25 16:13:51.383333 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Roles: reader,member Jun 25 16:13:51.385233 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0da9a82039c24056beec4b61f533eaa2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0da9a82039c24056beec4b61f533eaa2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0da9a82039c24056beec4b61f533eaa2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0da9a82039c24056beec4b61f533eaa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:13:51.385233 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1604464304 Jun 25 16:13:51.385233 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Id: 0da9a82039c24056beec4b61f533eaa2 Jun 25 16:13:51.385233 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1604464304 Jun 25 16:13:51.385233 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User: tempest-AttachVolumeShelveTestJSON-1604464304-project Jun 25 16:13:51.385233 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Id: default Jun 25 16:13:51.385233 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Name: Default Jun 25 16:13:51.385233 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Id: 744eb9d4e7084b7e9cae36d5de67f0f0 Jun 25 16:13:51.385233 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1604464304-project Jun 25 16:13:51.385233 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: method: > Jun 25 16:13:51.385233 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: exception: Instance e6ae5a58-db83-401e-a158-ebf0981e84ec could not be found. Jun 25 16:13:51.385233 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: action_args: {'id': 'e6ae5a58-db83-401e-a158-ebf0981e84ec'} Jun 25 16:13:51.385979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:13:51.385979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:13:51.385979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:13:51.385979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:13:51.385979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:13:51.385979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:13:51.385979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:13:51.385979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:13:51.385979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:13:51.385979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:13:51.385979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6ae5a58-db83-401e-a158-ebf0981e84ec could not be found. Jun 25 16:13:51.385979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:13:51.385979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:13:51.385979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:13:51.385979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:13:51.385979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:13:51.385979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:13:51.385979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:13:51.385979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:13:51.385979 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:13:51.387391 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:13:51.387391 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 16:13:51.387391 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 16:13:51.387391 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 16:13:51.387391 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 16:13:51.387391 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:13:51.387391 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:13:51.387391 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:13:51.387391 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:13:51.387391 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6ae5a58-db83-401e-a158-ebf0981e84ec could not be found. Jun 25 16:13:51.387391 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:13:51.387391 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:13:51.387391 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:13:51.387391 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:13:51.387391 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:13:51.387391 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:13:51.387391 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:13:51.387391 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:13:51.387391 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6ae5a58-db83-401e-a158-ebf0981e84ec could not be found. Jun 25 16:13:51.387391 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:13:51.389750 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-5bba4496-550b-4a61-aca2-97673257d42f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Returning 404 to user: Instance e6ae5a58-db83-401e-a158-ebf0981e84ec could not be found. {{(pid=117794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:13:51.389750 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-5bba4496-550b-4a61-aca2-97673257d42f tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 404 len: 111 microversion: 2.20 time: 0.031051 Jun 25 16:13:51.389750 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 402/810] 10.222.0.13 () {60 vars in 1279 bytes} [Sat Jun 25 16:13:51 2022] DELETE /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 25 16:13:51.394353 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-37333c8b-dc15-49f3-bf39-b853f95e88bd tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:51.395055 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-37333c8b-dc15-49f3-bf39-b853f95e88bd tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] [instance: e6ae5a58-db83-401e-a158-ebf0981e84ec] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:51.401217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-37333c8b-dc15-49f3-bf39-b853f95e88bd tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:51.401674 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-37333c8b-dc15-49f3-bf39-b853f95e88bd tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:51.402445 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-37333c8b-dc15-49f3-bf39-b853f95e88bd tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:51.403154 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-37333c8b-dc15-49f3-bf39-b853f95e88bd tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:51.416805 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-37333c8b-dc15-49f3-bf39-b853f95e88bd tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] HTTP exception thrown: Instance e6ae5a58-db83-401e-a158-ebf0981e84ec could not be found. Jun 25 16:13:51.418653 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-37333c8b-dc15-49f3-bf39-b853f95e88bd tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Request method failure captured: Jun 25 16:13:51.418653 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec HTTP/1.1 Jun 25 16:13:51.418653 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept: application/json Jun 25 16:13:51.418653 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jun 25 16:13:51.418653 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Connection: close Jun 25 16:13:51.418653 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jun 25 16:13:51.418653 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jun 25 16:13:51.418653 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Host: 10.222.0.13 Jun 25 16:13:51.418653 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jun 25 16:13:51.418653 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jun 25 16:13:51.418653 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABitzLPXaDcj4dKOPfgjjri_C1-SyRZTd_fhOKnzEyt4fLtf90pxk0LWGKMcZbbirj9taIcsoY2m9qLNoVV7QiH1vcCDpXJrf5HBr6Fjx1ws7rNRA3jbH6Qu15vUt34XH0i7OdnrurR7MupWyI759xgN8WUUKJ4adEv-bx7R7lzXeuZ-lk Jun 25 16:13:51.418653 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jun 25 16:13:51.418653 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jun 25 16:13:51.418653 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jun 25 16:13:51.418653 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jun 25 16:13:51.418653 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Openstack-Nova-Api-Version: 2.20 Jun 25 16:13:51.418653 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jun 25 16:13:51.418653 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jun 25 16:13:51.418653 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Id: 0da9a82039c24056beec4b61f533eaa2 Jun 25 16:13:51.418653 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1604464304 Jun 25 16:13:51.418653 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Role: reader,member Jun 25 16:13:51.418653 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Jun 25 16:13:51.420724 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0da9a82039c24056beec4b61f533eaa2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0da9a82039c24056beec4b61f533eaa2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0da9a82039c24056beec4b61f533eaa2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0da9a82039c24056beec4b61f533eaa2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:13:51.420724 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1604464304 Jun 25 16:13:51.420724 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 0da9a82039c24056beec4b61f533eaa2 Jun 25 16:13:51.420724 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1604464304 Jun 25 16:13:51.420724 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeShelveTestJSON-1604464304-project Jun 25 16:13:51.420724 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jun 25 16:13:51.420724 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jun 25 16:13:51.420724 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Id: 744eb9d4e7084b7e9cae36d5de67f0f0 Jun 25 16:13:51.420724 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1604464304-project Jun 25 16:13:51.420724 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: method: > Jun 25 16:13:51.420724 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: exception: Instance e6ae5a58-db83-401e-a158-ebf0981e84ec could not be found. Jun 25 16:13:51.420724 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: action_args: {'id': 'e6ae5a58-db83-401e-a158-ebf0981e84ec'} Jun 25 16:13:51.421775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:13:51.421775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:13:51.421775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:13:51.421775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:13:51.421775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:13:51.421775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:13:51.421775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:13:51.421775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:13:51.421775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:13:51.421775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:13:51.421775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6ae5a58-db83-401e-a158-ebf0981e84ec could not be found. Jun 25 16:13:51.421775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:13:51.421775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:13:51.421775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:13:51.421775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:13:51.421775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:13:51.421775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:13:51.421775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:13:51.421775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:13:51.421775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:13:51.423337 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:13:51.423337 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 16:13:51.423337 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 16:13:51.423337 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:13:51.423337 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:13:51.423337 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:13:51.423337 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:13:51.423337 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6ae5a58-db83-401e-a158-ebf0981e84ec could not be found. Jun 25 16:13:51.423337 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:13:51.423337 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:13:51.423337 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:13:51.423337 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:13:51.423337 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:13:51.423337 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:13:51.423337 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:13:51.423337 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:13:51.423337 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6ae5a58-db83-401e-a158-ebf0981e84ec could not be found. Jun 25 16:13:51.423337 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:13:51.424791 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-37333c8b-dc15-49f3-bf39-b853f95e88bd tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] Returning 404 to user: Instance e6ae5a58-db83-401e-a158-ebf0981e84ec could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:13:51.424791 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-37333c8b-dc15-49f3-bf39-b853f95e88bd tempest-AttachVolumeShelveTestJSON-1604464304 tempest-AttachVolumeShelveTestJSON-1604464304-project] 10.222.0.13 "GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec" status: 404 len: 111 microversion: 2.20 time: 0.029805 Jun 25 16:13:51.424791 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 409/811] 10.222.0.13 () {60 vars in 1276 bytes} [Sat Jun 25 16:13:51 2022] GET /compute/v2.1/servers/e6ae5a58-db83-401e-a158-ebf0981e84ec => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 25 16:13:51.639614 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-8fb32a3f-4fce-45a2-b38c-99cff65dbdf0 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:51.640558 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-8fb32a3f-4fce-45a2-b38c-99cff65dbdf0 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 3193adb5-3665-405c-b68c-30023d88105d] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:51.646911 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8fb32a3f-4fce-45a2-b38c-99cff65dbdf0 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:51.647363 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8fb32a3f-4fce-45a2-b38c-99cff65dbdf0 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:51.648176 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8fb32a3f-4fce-45a2-b38c-99cff65dbdf0 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:51.648681 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8fb32a3f-4fce-45a2-b38c-99cff65dbdf0 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:51.780834 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-8fb32a3f-4fce-45a2-b38c-99cff65dbdf0 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:51.789287 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-8fb32a3f-4fce-45a2-b38c-99cff65dbdf0 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d" status: 200 len: 1265 microversion: 2.1 time: 0.153847 Jun 25 16:13:51.798809 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 403/812] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:51 2022] GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:13:52.375068 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b4c1502e-fa7e-45cb-b084-c107233eb420 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:52.375778 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b4c1502e-fa7e-45cb-b084-c107233eb420 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:52.382928 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b4c1502e-fa7e-45cb-b084-c107233eb420 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:52.383455 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b4c1502e-fa7e-45cb-b084-c107233eb420 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:52.384297 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b4c1502e-fa7e-45cb-b084-c107233eb420 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:52.384772 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b4c1502e-fa7e-45cb-b084-c107233eb420 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:52.530630 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b4c1502e-fa7e-45cb-b084-c107233eb420 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:52.538411 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b4c1502e-fa7e-45cb-b084-c107233eb420 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1653 microversion: 2.1 time: 0.167452 Jun 25 16:13:52.538982 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 410/813] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:52 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1653 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:13:52.556305 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-5542a694-6922-4aea-a836-90b12df3d069 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:13:52.563232 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5542a694-6922-4aea-a836-90b12df3d069 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:52.563635 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5542a694-6922-4aea-a836-90b12df3d069 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:52.589051 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-5542a694-6922-4aea-a836-90b12df3d069 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Going to try to start instance {{(pid=117794) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 25 16:13:52.640364 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-5542a694-6922-4aea-a836-90b12df3d069 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "POST /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695/action" status: 202 len: 0 microversion: 2.1 time: 0.088040 Jun 25 16:13:52.640998 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 404/814] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Jun 25 16:13:52 2022] POST /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 16:13:52.649413 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f84ac1f1-79c0-4923-8af4-257fd7c3ab2e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:52.650281 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f84ac1f1-79c0-4923-8af4-257fd7c3ab2e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:52.657546 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f84ac1f1-79c0-4923-8af4-257fd7c3ab2e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:52.658076 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f84ac1f1-79c0-4923-8af4-257fd7c3ab2e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:52.658913 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f84ac1f1-79c0-4923-8af4-257fd7c3ab2e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:52.659416 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f84ac1f1-79c0-4923-8af4-257fd7c3ab2e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:52.807388 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-e8c6e110-a60a-44cd-91e2-15b73f17a614 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:52.808360 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-e8c6e110-a60a-44cd-91e2-15b73f17a614 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 3193adb5-3665-405c-b68c-30023d88105d] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:52.815683 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e8c6e110-a60a-44cd-91e2-15b73f17a614 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:52.816140 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e8c6e110-a60a-44cd-91e2-15b73f17a614 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:52.816956 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e8c6e110-a60a-44cd-91e2-15b73f17a614 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:52.817400 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e8c6e110-a60a-44cd-91e2-15b73f17a614 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:52.831392 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f84ac1f1-79c0-4923-8af4-257fd7c3ab2e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:52.843028 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f84ac1f1-79c0-4923-8af4-257fd7c3ab2e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1662 microversion: 2.1 time: 0.197248 Jun 25 16:13:52.846172 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 411/815] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:52 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1662 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:13:53.071868 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-e8c6e110-a60a-44cd-91e2-15b73f17a614 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:53.087561 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-e8c6e110-a60a-44cd-91e2-15b73f17a614 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d" status: 200 len: 1265 microversion: 2.1 time: 0.284204 Jun 25 16:13:53.100039 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 405/816] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:52 2022] GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d => generated 1265 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:13:53.875305 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-68a8ada9-dc2a-4f35-bac9-01b7d35b2c35 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:53.875952 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-68a8ada9-dc2a-4f35-bac9-01b7d35b2c35 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:53.885486 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-68a8ada9-dc2a-4f35-bac9-01b7d35b2c35 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:53.886182 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-68a8ada9-dc2a-4f35-bac9-01b7d35b2c35 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:53.887505 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-68a8ada9-dc2a-4f35-bac9-01b7d35b2c35 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:53.888092 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-68a8ada9-dc2a-4f35-bac9-01b7d35b2c35 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:53.913200 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=100 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:13:53.946982 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-776223c6-30b7-46b5-9165-dc5ce1ea24a8 req-ba8faba7-ef58-4d62-96d8-3297f0f9442a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3193adb5-3665-405c-b68c-30023d88105d", "name": "network-vif-plugged", "status": "completed", "tag": "1a9f7280-53f6-4175-893c-f00a3bb1d1d4"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:13:53.956868 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-776223c6-30b7-46b5-9165-dc5ce1ea24a8 req-ba8faba7-ef58-4d62-96d8-3297f0f9442a service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:53.957330 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-776223c6-30b7-46b5-9165-dc5ce1ea24a8 req-ba8faba7-ef58-4d62-96d8-3297f0f9442a service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:53.981077 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-776223c6-30b7-46b5-9165-dc5ce1ea24a8 req-ba8faba7-ef58-4d62-96d8-3297f0f9442a service nova] Creating event network-vif-plugged:1a9f7280-53f6-4175-893c-f00a3bb1d1d4 for instance 3193adb5-3665-405c-b68c-30023d88105d on hv-cinder-84762 Jun 25 16:13:53.986866 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-776223c6-30b7-46b5-9165-dc5ce1ea24a8 req-ba8faba7-ef58-4d62-96d8-3297f0f9442a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048101 Jun 25 16:13:53.987943 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 406/817] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:13:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 25 16:13:54.051354 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-68a8ada9-dc2a-4f35-bac9-01b7d35b2c35 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:54.059544 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-68a8ada9-dc2a-4f35-bac9-01b7d35b2c35 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1662 microversion: 2.1 time: 0.196926 Jun 25 16:13:54.060310 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 412/818] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:53 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1662 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:13:54.105463 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-2a358475-9c4f-49b0-be61-821de99026eb tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:54.107034 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-2a358475-9c4f-49b0-be61-821de99026eb tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 3193adb5-3665-405c-b68c-30023d88105d] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:54.114232 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2a358475-9c4f-49b0-be61-821de99026eb tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:54.114812 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2a358475-9c4f-49b0-be61-821de99026eb tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:54.115666 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2a358475-9c4f-49b0-be61-821de99026eb tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:54.116213 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2a358475-9c4f-49b0-be61-821de99026eb tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:54.289160 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-2a358475-9c4f-49b0-be61-821de99026eb tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:54.304170 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-2a358475-9c4f-49b0-be61-821de99026eb tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d" status: 200 len: 1265 microversion: 2.1 time: 0.203020 Jun 25 16:13:54.305076 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 407/819] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:54 2022] GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d => generated 1265 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:13:55.078313 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a13d2b9d-cd06-4bcd-91c0-c60d6f0944c4 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:55.078935 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a13d2b9d-cd06-4bcd-91c0-c60d6f0944c4 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:55.085851 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a13d2b9d-cd06-4bcd-91c0-c60d6f0944c4 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:55.086308 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a13d2b9d-cd06-4bcd-91c0-c60d6f0944c4 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:55.087086 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a13d2b9d-cd06-4bcd-91c0-c60d6f0944c4 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:55.087520 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a13d2b9d-cd06-4bcd-91c0-c60d6f0944c4 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:55.223480 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a13d2b9d-cd06-4bcd-91c0-c60d6f0944c4 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:55.232128 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a13d2b9d-cd06-4bcd-91c0-c60d6f0944c4 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1666 microversion: 2.1 time: 0.158340 Jun 25 16:13:55.232759 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 413/820] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:55 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1666 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:13:55.323535 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-91680ab0-053f-4cd5-9482-2f9b5ec3b457 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:55.324308 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-91680ab0-053f-4cd5-9482-2f9b5ec3b457 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 3193adb5-3665-405c-b68c-30023d88105d] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:55.330537 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-91680ab0-053f-4cd5-9482-2f9b5ec3b457 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:55.330983 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-91680ab0-053f-4cd5-9482-2f9b5ec3b457 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:55.331735 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-91680ab0-053f-4cd5-9482-2f9b5ec3b457 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:55.332162 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-91680ab0-053f-4cd5-9482-2f9b5ec3b457 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:55.475209 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-91680ab0-053f-4cd5-9482-2f9b5ec3b457 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:55.482973 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-91680ab0-053f-4cd5-9482-2f9b5ec3b457 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d" status: 200 len: 1265 microversion: 2.1 time: 0.163227 Jun 25 16:13:55.483609 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 408/821] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:55 2022] GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:13:56.499536 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8985b190-718b-40bc-8a94-d3b83c005cb2 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:56.500142 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8985b190-718b-40bc-8a94-d3b83c005cb2 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 3193adb5-3665-405c-b68c-30023d88105d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:56.507204 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8985b190-718b-40bc-8a94-d3b83c005cb2 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:56.507510 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8985b190-718b-40bc-8a94-d3b83c005cb2 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:56.508362 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8985b190-718b-40bc-8a94-d3b83c005cb2 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:56.508871 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8985b190-718b-40bc-8a94-d3b83c005cb2 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:56.640433 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8985b190-718b-40bc-8a94-d3b83c005cb2 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:56.648491 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8985b190-718b-40bc-8a94-d3b83c005cb2 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d" status: 200 len: 1453 microversion: 2.1 time: 0.153183 Jun 25 16:13:56.649178 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 414/822] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:56 2022] GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:13:56.665912 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-607d1e98-5eaa-48e6-a7c6-3955f0b4ca24 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:13:56.666521 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-607d1e98-5eaa-48e6-a7c6-3955f0b4ca24 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 3193adb5-3665-405c-b68c-30023d88105d] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:13:56.673290 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-607d1e98-5eaa-48e6-a7c6-3955f0b4ca24 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:56.673771 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-607d1e98-5eaa-48e6-a7c6-3955f0b4ca24 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:56.674526 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-607d1e98-5eaa-48e6-a7c6-3955f0b4ca24 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:56.674962 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-607d1e98-5eaa-48e6-a7c6-3955f0b4ca24 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:56.805171 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-607d1e98-5eaa-48e6-a7c6-3955f0b4ca24 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:13:56.813250 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-607d1e98-5eaa-48e6-a7c6-3955f0b4ca24 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d" status: 200 len: 1453 microversion: 2.1 time: 0.151272 Jun 25 16:13:56.813887 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 409/823] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:13:56 2022] GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:13:58.641417 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-d6680bb9-260f-4b56-956f-ca6288d97684 req-c913575c-4db0-4e0c-9ebe-37bab1398011 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3193adb5-3665-405c-b68c-30023d88105d", "tag": "1a9f7280-53f6-4175-893c-f00a3bb1d1d4"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:13:58.649968 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-d6680bb9-260f-4b56-956f-ca6288d97684 req-c913575c-4db0-4e0c-9ebe-37bab1398011 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:13:58.650403 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-d6680bb9-260f-4b56-956f-ca6288d97684 req-c913575c-4db0-4e0c-9ebe-37bab1398011 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:13:58.661465 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-d6680bb9-260f-4b56-956f-ca6288d97684 req-c913575c-4db0-4e0c-9ebe-37bab1398011 service nova] Creating event network-changed:1a9f7280-53f6-4175-893c-f00a3bb1d1d4 for instance 3193adb5-3665-405c-b68c-30023d88105d on hv-cinder-84762 Jun 25 16:13:58.666416 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-d6680bb9-260f-4b56-956f-ca6288d97684 req-c913575c-4db0-4e0c-9ebe-37bab1398011 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029051 Jun 25 16:13:58.667006 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 415/824] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:13:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:14:28.604099 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-2f0eeecc-6de1-473a-b61e-f78e819fe070 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:14:28.605269 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-2f0eeecc-6de1-473a-b61e-f78e819fe070 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:14:28.607553 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:14:28.608239 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:14:28.614547 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2f0eeecc-6de1-473a-b61e-f78e819fe070 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:28.615013 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2f0eeecc-6de1-473a-b61e-f78e819fe070 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:28.615803 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2f0eeecc-6de1-473a-b61e-f78e819fe070 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:28.616242 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2f0eeecc-6de1-473a-b61e-f78e819fe070 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:28.650909 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-2f0eeecc-6de1-473a-b61e-f78e819fe070 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051153 Jun 25 16:14:28.651704 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 410/825] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Jun 25 16:14:28 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 16:14:28.710519 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:14:28.711359 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=16 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:14:28.716048 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5fe1c97f-9c6e-4c2c-a0a5-ae66133a5e98 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:14:28.716693 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5fe1c97f-9c6e-4c2c-a0a5-ae66133a5e98 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:14:28.724462 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5fe1c97f-9c6e-4c2c-a0a5-ae66133a5e98 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:28.725057 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5fe1c97f-9c6e-4c2c-a0a5-ae66133a5e98 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:28.725812 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5fe1c97f-9c6e-4c2c-a0a5-ae66133a5e98 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:28.726485 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5fe1c97f-9c6e-4c2c-a0a5-ae66133a5e98 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:28.757412 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5fe1c97f-9c6e-4c2c-a0a5-ae66133a5e98 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 16:14:28.846793 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5fe1c97f-9c6e-4c2c-a0a5-ae66133a5e98 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 204 len: 0 microversion: 2.1 time: 0.137713 Jun 25 16:14:28.848006 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 416/826] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Jun 25 16:14:28 2022] DELETE /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 16:14:28.858327 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-616ad108-8847-48ce-b66e-80df91142e69 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:14:28.859381 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-616ad108-8847-48ce-b66e-80df91142e69 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:14:28.875617 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-616ad108-8847-48ce-b66e-80df91142e69 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:28.876131 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-616ad108-8847-48ce-b66e-80df91142e69 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:28.876973 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-616ad108-8847-48ce-b66e-80df91142e69 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:28.877591 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-616ad108-8847-48ce-b66e-80df91142e69 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:29.033584 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-616ad108-8847-48ce-b66e-80df91142e69 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:14:29.045751 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-616ad108-8847-48ce-b66e-80df91142e69 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1672 microversion: 2.1 time: 0.192120 Jun 25 16:14:29.046546 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 411/827] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:14:28 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1672 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:14:30.067729 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-024eb2b7-26f8-4c85-8e49-9e4331ff82e8 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:14:30.068452 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-024eb2b7-26f8-4c85-8e49-9e4331ff82e8 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:14:30.076133 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-024eb2b7-26f8-4c85-8e49-9e4331ff82e8 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:30.076622 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-024eb2b7-26f8-4c85-8e49-9e4331ff82e8 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:30.077436 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-024eb2b7-26f8-4c85-8e49-9e4331ff82e8 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:30.077868 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-024eb2b7-26f8-4c85-8e49-9e4331ff82e8 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:30.212667 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-024eb2b7-26f8-4c85-8e49-9e4331ff82e8 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:14:30.220830 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-024eb2b7-26f8-4c85-8e49-9e4331ff82e8 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1672 microversion: 2.1 time: 0.157418 Jun 25 16:14:30.221396 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 417/828] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:14:30 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:14:31.243425 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-272a1daf-f85f-41e4-9c3e-e80c967f0d70 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:14:31.244380 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-272a1daf-f85f-41e4-9c3e-e80c967f0d70 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:14:31.252094 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-272a1daf-f85f-41e4-9c3e-e80c967f0d70 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:31.252580 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-272a1daf-f85f-41e4-9c3e-e80c967f0d70 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:31.253352 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-272a1daf-f85f-41e4-9c3e-e80c967f0d70 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:31.253793 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-272a1daf-f85f-41e4-9c3e-e80c967f0d70 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:31.472968 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-272a1daf-f85f-41e4-9c3e-e80c967f0d70 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:14:31.485233 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-272a1daf-f85f-41e4-9c3e-e80c967f0d70 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1672 microversion: 2.1 time: 0.248255 Jun 25 16:14:31.485933 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 412/829] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:14:31 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1672 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:14:32.489159 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-7e36b92d-a6e0-4e9a-9003-7db828d35ec6 req-78768178-d2da-40f1-a45c-a507bc483ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0460a39-cea4-4afc-92b3-091c5a768695", "name": "network-vif-deleted", "tag": "4f5f9d67-66aa-4e41-9fa6-b9aeeb540e5c"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:14:32.502749 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-2450d359-e24b-41fc-a698-2e91baa11c81 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:14:32.503296 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-2450d359-e24b-41fc-a698-2e91baa11c81 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:14:32.504330 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-7e36b92d-a6e0-4e9a-9003-7db828d35ec6 req-78768178-d2da-40f1-a45c-a507bc483ed7 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:32.505049 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-7e36b92d-a6e0-4e9a-9003-7db828d35ec6 req-78768178-d2da-40f1-a45c-a507bc483ed7 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:32.510023 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2450d359-e24b-41fc-a698-2e91baa11c81 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:32.510406 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2450d359-e24b-41fc-a698-2e91baa11c81 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:32.511317 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2450d359-e24b-41fc-a698-2e91baa11c81 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:32.514606 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2450d359-e24b-41fc-a698-2e91baa11c81 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:32.529285 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-7e36b92d-a6e0-4e9a-9003-7db828d35ec6 req-78768178-d2da-40f1-a45c-a507bc483ed7 service nova] Creating event network-vif-deleted:4f5f9d67-66aa-4e41-9fa6-b9aeeb540e5c for instance d0460a39-cea4-4afc-92b3-091c5a768695 on hv-cinder-84762 Jun 25 16:14:32.535582 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-7e36b92d-a6e0-4e9a-9003-7db828d35ec6 req-78768178-d2da-40f1-a45c-a507bc483ed7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049985 Jun 25 16:14:32.536990 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 418/830] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:14:32.585662 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-2450d359-e24b-41fc-a698-2e91baa11c81 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:14:32.595838 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-2450d359-e24b-41fc-a698-2e91baa11c81 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 200 len: 1323 microversion: 2.1 time: 0.096944 Jun 25 16:14:32.599487 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 413/831] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:14:32 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 1323 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:14:33.613993 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-acaa1b0e-9d59-44e3-aff8-86d98fdc1590 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:14:33.615439 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-acaa1b0e-9d59-44e3-aff8-86d98fdc1590 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:14:33.623066 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-acaa1b0e-9d59-44e3-aff8-86d98fdc1590 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:33.623522 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-acaa1b0e-9d59-44e3-aff8-86d98fdc1590 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:33.624333 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-acaa1b0e-9d59-44e3-aff8-86d98fdc1590 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:33.624803 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-acaa1b0e-9d59-44e3-aff8-86d98fdc1590 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:33.639418 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-acaa1b0e-9d59-44e3-aff8-86d98fdc1590 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] HTTP exception thrown: Instance d0460a39-cea4-4afc-92b3-091c5a768695 could not be found. Jun 25 16:14:33.641148 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-acaa1b0e-9d59-44e3-aff8-86d98fdc1590 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Request method failure captured: Jun 25 16:14:33.641148 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 HTTP/1.1 Jun 25 16:14:33.641148 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept: application/json Jun 25 16:14:33.641148 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jun 25 16:14:33.641148 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Connection: close Jun 25 16:14:33.641148 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jun 25 16:14:33.641148 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jun 25 16:14:33.641148 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Host: 10.222.0.13 Jun 25 16:14:33.641148 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jun 25 16:14:33.641148 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jun 25 16:14:33.641148 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABitzO-OK9jhEcDWyxqOa8K-5Le5kJKq_SsM4XXokc7VVmoPPd-42rHpgqLb-hZ2UQvDe9jcgPLvsz3UPtKOnJuq8JVcsXwBOgCF4l9qa3QXae1V1RlJSU2e3mJLgHcfBWdkdqzMQRNBtqwcGpODk_8Vj3wdrBfuly72pvE_y1gMlL8jlA Jun 25 16:14:33.641148 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jun 25 16:14:33.641148 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jun 25 16:14:33.641148 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jun 25 16:14:33.641148 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jun 25 16:14:33.641148 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jun 25 16:14:33.641148 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jun 25 16:14:33.641148 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Id: 93ca9301bea041ce881109c706904a0a Jun 25 16:14:33.641148 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeTestJSON-1792173987 Jun 25 16:14:33.641148 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Role: reader,member Jun 25 16:14:33.641148 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Jun 25 16:14:33.642807 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/93ca9301bea041ce881109c706904a0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/93ca9301bea041ce881109c706904a0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_93ca9301bea041ce881109c706904a0a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/93ca9301bea041ce881109c706904a0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:14:33.642807 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeTestJSON-1792173987 Jun 25 16:14:33.642807 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 93ca9301bea041ce881109c706904a0a Jun 25 16:14:33.642807 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1792173987 Jun 25 16:14:33.642807 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeTestJSON-1792173987-project Jun 25 16:14:33.642807 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jun 25 16:14:33.642807 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jun 25 16:14:33.642807 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Id: 5c2141524dc546259cd993ace59e33f3 Jun 25 16:14:33.642807 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeTestJSON-1792173987-project Jun 25 16:14:33.642807 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: method: > Jun 25 16:14:33.642807 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: exception: Instance d0460a39-cea4-4afc-92b3-091c5a768695 could not be found. Jun 25 16:14:33.642807 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: action_args: {'id': 'd0460a39-cea4-4afc-92b3-091c5a768695'} Jun 25 16:14:33.643631 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:14:33.643631 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:14:33.643631 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:14:33.643631 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:14:33.643631 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:14:33.643631 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:14:33.643631 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:14:33.643631 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:14:33.643631 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:14:33.643631 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:14:33.643631 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0460a39-cea4-4afc-92b3-091c5a768695 could not be found. Jun 25 16:14:33.643631 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:14:33.643631 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:14:33.643631 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:14:33.643631 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:14:33.643631 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:14:33.643631 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:14:33.643631 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:14:33.643631 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:14:33.643631 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:14:33.645527 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:14:33.645527 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 16:14:33.645527 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 16:14:33.645527 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:14:33.645527 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:14:33.645527 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:14:33.645527 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:14:33.645527 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0460a39-cea4-4afc-92b3-091c5a768695 could not be found. Jun 25 16:14:33.645527 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:14:33.645527 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:14:33.645527 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:14:33.645527 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:14:33.645527 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:14:33.645527 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:14:33.645527 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:14:33.645527 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:14:33.645527 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0460a39-cea4-4afc-92b3-091c5a768695 could not be found. Jun 25 16:14:33.645527 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:14:33.647162 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-acaa1b0e-9d59-44e3-aff8-86d98fdc1590 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Returning 404 to user: Instance d0460a39-cea4-4afc-92b3-091c5a768695 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:14:33.647162 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-acaa1b0e-9d59-44e3-aff8-86d98fdc1590 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 404 len: 111 microversion: 2.1 time: 0.033028 Jun 25 16:14:33.647162 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 419/832] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:14:33 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:14:33.652105 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-d09a4d55-918a-4674-a06d-f7d26781beb1 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '.version_select at 0x7f65bb4ef5e0>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:14:33.672644 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-d09a4d55-918a-4674-a06d-f7d26781beb1 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1345989781" status: 202 len: 0 microversion: 2.1 time: 0.024294 Jun 25 16:14:33.673273 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 414/833] 10.222.0.13 () {58 vars in 1220 bytes} [Sat Jun 25 16:14:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1345989781 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 16:14:34.314180 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7f88fe3f-b674-42f9-8ae8-97f69efa1e43 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Action: 'create', calling method: .version_select at 0x7f65bb551310>, body: {"keypair": {"name": "tempest-keypair-469763489", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNneKrRLAuQiTz8+63BjhIi3Fl/DzJiM5Wf0pSyttSDeYLYIjNB95hJYkPsC0qxkNlwpJU6DU4/BeX8CkMMVDy3bC8DBdzHYRLOVWqjtA2FQa7QRKhk92vLC0pt975T9Qg=="}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:14:34.328665 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-7f88fe3f-b674-42f9-8ae8-97f69efa1e43 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Getting quotas for project 93ca9301bea041ce881109c706904a0a. Resources: {'key_pairs'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:14:34.332549 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-7f88fe3f-b674-42f9-8ae8-97f69efa1e43 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Getting quotas for user 5c2141524dc546259cd993ace59e33f3 and project 93ca9301bea041ce881109c706904a0a. Resources: {'key_pairs'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:14:34.357404 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7f88fe3f-b674-42f9-8ae8-97f69efa1e43 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046875 Jun 25 16:14:34.358183 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 420/834] 10.222.0.13 () {60 vars in 1158 bytes} [Sat Jun 25 16:14:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:14:35.750805 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-5fb3e404-e887-478b-9fcb-3d5341d1ebee tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1189689862", "imageRef": "84c164fa-276d-4693-b7a0-24fd3024b359", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f17f727c-497a-440f-921d-f0ec313048f6"}], "security_groups": [{"name": "tempest-securitygroup--776130563"}], "key_name": "tempest-keypair-469763489", "user_data": "}} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:14:35.859441 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.network.neutron [None req-5fb3e404-e887-478b-9fcb-3d5341d1ebee tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] validate_networks() for [('f17f727c-497a-440f-921d-f0ec313048f6', None, None, None, None, None)] {{(pid=117794) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 16:14:36.351073 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-5fb3e404-e887-478b-9fcb-3d5341d1ebee tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Flavor limits 0:0:0 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 16:14:36.351528 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-5fb3e404-e887-478b-9fcb-3d5341d1ebee tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Image limits 0:0:0 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 16:14:36.351974 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-5fb3e404-e887-478b-9fcb-3d5341d1ebee tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Flavor pref 0:0:0 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 16:14:36.352379 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-5fb3e404-e887-478b-9fcb-3d5341d1ebee tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Image pref 0:0:0 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 16:14:36.352823 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-5fb3e404-e887-478b-9fcb-3d5341d1ebee tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 16:14:36.362691 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5fb3e404-e887-478b-9fcb-3d5341d1ebee tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:36.363139 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5fb3e404-e887-478b-9fcb-3d5341d1ebee tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:36.363932 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5fb3e404-e887-478b-9fcb-3d5341d1ebee tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:36.364431 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5fb3e404-e887-478b-9fcb-3d5341d1ebee tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:36.380987 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.quota [None req-5fb3e404-e887-478b-9fcb-3d5341d1ebee tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Getting quotas for project 93ca9301bea041ce881109c706904a0a. Resources: {'ram', 'cores', 'instances'} {{(pid=117794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:14:36.385026 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.quota [None req-5fb3e404-e887-478b-9fcb-3d5341d1ebee tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Getting quotas for user 5c2141524dc546259cd993ace59e33f3 and project 93ca9301bea041ce881109c706904a0a. Resources: {'ram', 'cores', 'instances'} {{(pid=117794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:14:36.398720 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-5fb3e404-e887-478b-9fcb-3d5341d1ebee tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Going to run 1 instances... {{(pid=117794) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 16:14:36.401671 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-5fb3e404-e887-478b-9fcb-3d5341d1ebee tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: 2e42b781-8a83-4b8c-8499-46992761eafe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84c164fa-276d-4693-b7a0-24fd3024b359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 16:14:36.451152 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-5fb3e404-e887-478b-9fcb-3d5341d1ebee tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.704915 Jun 25 16:14:36.452071 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 415/835] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Jun 25 16:14:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 16:14:36.462485 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f043e0cb-2d36-4abd-bd17-d704a6da133e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:14:36.463140 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f043e0cb-2d36-4abd-bd17-d704a6da133e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: 2e42b781-8a83-4b8c-8499-46992761eafe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:14:36.531093 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f043e0cb-2d36-4abd-bd17-d704a6da133e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:14:36.539135 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f043e0cb-2d36-4abd-bd17-d704a6da133e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe" status: 200 len: 1237 microversion: 2.1 time: 0.080814 Jun 25 16:14:36.539701 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 421/836] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:14:36 2022] GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe => generated 1237 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:14:37.557634 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-681accdb-416a-450c-9867-7f73f3e9000d tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:14:37.558921 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-681accdb-416a-450c-9867-7f73f3e9000d tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: 2e42b781-8a83-4b8c-8499-46992761eafe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:14:37.566143 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-681accdb-416a-450c-9867-7f73f3e9000d tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:37.566658 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-681accdb-416a-450c-9867-7f73f3e9000d tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:37.567483 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-681accdb-416a-450c-9867-7f73f3e9000d tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:37.567980 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-681accdb-416a-450c-9867-7f73f3e9000d tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:37.630532 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-681accdb-416a-450c-9867-7f73f3e9000d tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:14:37.638504 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-681accdb-416a-450c-9867-7f73f3e9000d tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe" status: 200 len: 1295 microversion: 2.1 time: 0.086152 Jun 25 16:14:37.639396 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 416/837] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:14:37 2022] GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe => generated 1295 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:14:38.662436 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a02e8926-e0f3-406a-889a-afa95702e9a0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:14:38.663891 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a02e8926-e0f3-406a-889a-afa95702e9a0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: 2e42b781-8a83-4b8c-8499-46992761eafe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:14:38.671966 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a02e8926-e0f3-406a-889a-afa95702e9a0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:38.672602 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a02e8926-e0f3-406a-889a-afa95702e9a0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:38.673644 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a02e8926-e0f3-406a-889a-afa95702e9a0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:38.674143 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a02e8926-e0f3-406a-889a-afa95702e9a0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:38.882167 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a02e8926-e0f3-406a-889a-afa95702e9a0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:14:38.892096 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a02e8926-e0f3-406a-889a-afa95702e9a0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe" status: 200 len: 1362 microversion: 2.1 time: 0.240424 Jun 25 16:14:38.892702 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 422/838] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:14:38 2022] GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe => generated 1362 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:14:38.940362 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-85eee715-5f93-4dbb-b6f1-d5950511428a req-d3713dc8-349e-4415-ba95-54fbb053cd93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e42b781-8a83-4b8c-8499-46992761eafe", "tag": "8035843a-a113-464b-9ba4-185653805a8d"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:14:38.950304 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-85eee715-5f93-4dbb-b6f1-d5950511428a req-d3713dc8-349e-4415-ba95-54fbb053cd93 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:38.951011 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-85eee715-5f93-4dbb-b6f1-d5950511428a req-d3713dc8-349e-4415-ba95-54fbb053cd93 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:38.963504 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-85eee715-5f93-4dbb-b6f1-d5950511428a req-d3713dc8-349e-4415-ba95-54fbb053cd93 service nova] Creating event network-changed:8035843a-a113-464b-9ba4-185653805a8d for instance 2e42b781-8a83-4b8c-8499-46992761eafe on hv-cinder-84762 Jun 25 16:14:38.974458 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-85eee715-5f93-4dbb-b6f1-d5950511428a req-d3713dc8-349e-4415-ba95-54fbb053cd93 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037477 Jun 25 16:14:38.976189 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 417/839] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:14:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:14:39.909800 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-67ab602b-7dd1-40c6-8578-c92a61457a53 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:14:39.910344 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-67ab602b-7dd1-40c6-8578-c92a61457a53 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: 2e42b781-8a83-4b8c-8499-46992761eafe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:14:39.917078 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-67ab602b-7dd1-40c6-8578-c92a61457a53 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:39.917548 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-67ab602b-7dd1-40c6-8578-c92a61457a53 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:39.918320 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-67ab602b-7dd1-40c6-8578-c92a61457a53 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:39.918751 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-67ab602b-7dd1-40c6-8578-c92a61457a53 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:40.051418 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-67ab602b-7dd1-40c6-8578-c92a61457a53 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:14:40.059052 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-67ab602b-7dd1-40c6-8578-c92a61457a53 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe" status: 200 len: 1362 microversion: 2.1 time: 0.153455 Jun 25 16:14:40.059608 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 423/840] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:14:39 2022] GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:14:41.077742 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-4d7cd70a-0448-4186-b6ac-da13315c802b tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:14:41.078537 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-4d7cd70a-0448-4186-b6ac-da13315c802b tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: 2e42b781-8a83-4b8c-8499-46992761eafe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:14:41.085481 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4d7cd70a-0448-4186-b6ac-da13315c802b tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:41.085937 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4d7cd70a-0448-4186-b6ac-da13315c802b tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:41.086698 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4d7cd70a-0448-4186-b6ac-da13315c802b tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:41.087132 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-4d7cd70a-0448-4186-b6ac-da13315c802b tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:41.217685 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-4d7cd70a-0448-4186-b6ac-da13315c802b tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:14:41.229216 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-4d7cd70a-0448-4186-b6ac-da13315c802b tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe" status: 200 len: 1362 microversion: 2.1 time: 0.156253 Jun 25 16:14:41.229886 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 418/841] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:14:41 2022] GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:14:42.248987 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6189fedb-dc6c-435d-968e-8f2379f126d0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:14:42.249605 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6189fedb-dc6c-435d-968e-8f2379f126d0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: 2e42b781-8a83-4b8c-8499-46992761eafe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:14:42.260230 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6189fedb-dc6c-435d-968e-8f2379f126d0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:42.260932 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6189fedb-dc6c-435d-968e-8f2379f126d0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:42.261881 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6189fedb-dc6c-435d-968e-8f2379f126d0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:42.262293 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6189fedb-dc6c-435d-968e-8f2379f126d0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:42.411132 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6189fedb-dc6c-435d-968e-8f2379f126d0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:14:42.419158 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6189fedb-dc6c-435d-968e-8f2379f126d0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe" status: 200 len: 1362 microversion: 2.1 time: 0.176425 Jun 25 16:14:42.419833 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 424/842] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:14:42 2022] GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:14:43.437005 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-e3024d43-0048-4144-b8e7-767227702f57 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:14:43.437648 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-e3024d43-0048-4144-b8e7-767227702f57 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: 2e42b781-8a83-4b8c-8499-46992761eafe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:14:43.444709 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e3024d43-0048-4144-b8e7-767227702f57 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:43.445180 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e3024d43-0048-4144-b8e7-767227702f57 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:43.445930 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e3024d43-0048-4144-b8e7-767227702f57 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:43.446366 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e3024d43-0048-4144-b8e7-767227702f57 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:43.577497 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-e3024d43-0048-4144-b8e7-767227702f57 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:14:43.587316 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-e3024d43-0048-4144-b8e7-767227702f57 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe" status: 200 len: 1362 microversion: 2.1 time: 0.154351 Jun 25 16:14:43.587959 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 419/843] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:14:43 2022] GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:14:44.146998 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-d06465f4-0a56-4e0e-bc33-a813cae2369f req-537eb530-246e-40cc-bd48-c452579f825a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e42b781-8a83-4b8c-8499-46992761eafe", "name": "network-vif-plugged", "status": "completed", "tag": "8035843a-a113-464b-9ba4-185653805a8d"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:14:44.156729 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-d06465f4-0a56-4e0e-bc33-a813cae2369f req-537eb530-246e-40cc-bd48-c452579f825a service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:44.157254 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-d06465f4-0a56-4e0e-bc33-a813cae2369f req-537eb530-246e-40cc-bd48-c452579f825a service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:44.169140 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-d06465f4-0a56-4e0e-bc33-a813cae2369f req-537eb530-246e-40cc-bd48-c452579f825a service nova] Creating event network-vif-plugged:8035843a-a113-464b-9ba4-185653805a8d for instance 2e42b781-8a83-4b8c-8499-46992761eafe on hv-cinder-84762 Jun 25 16:14:44.174449 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-d06465f4-0a56-4e0e-bc33-a813cae2369f req-537eb530-246e-40cc-bd48-c452579f825a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031162 Jun 25 16:14:44.175067 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 425/844] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:14:44.604335 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-10b6d52b-74c0-4220-a405-66ee26e935aa tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:14:44.604978 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-10b6d52b-74c0-4220-a405-66ee26e935aa tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: 2e42b781-8a83-4b8c-8499-46992761eafe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:14:44.611789 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-10b6d52b-74c0-4220-a405-66ee26e935aa tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:44.612207 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-10b6d52b-74c0-4220-a405-66ee26e935aa tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:44.613010 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-10b6d52b-74c0-4220-a405-66ee26e935aa tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:44.613478 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-10b6d52b-74c0-4220-a405-66ee26e935aa tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:44.754151 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-10b6d52b-74c0-4220-a405-66ee26e935aa tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:14:44.762510 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-10b6d52b-74c0-4220-a405-66ee26e935aa tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe" status: 200 len: 1362 microversion: 2.1 time: 0.162086 Jun 25 16:14:44.763097 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 420/845] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:14:44 2022] GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:14:45.785660 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9ea34293-4513-4f70-b4fa-e83f4212e531 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:14:45.786886 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9ea34293-4513-4f70-b4fa-e83f4212e531 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: 2e42b781-8a83-4b8c-8499-46992761eafe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:14:45.795851 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9ea34293-4513-4f70-b4fa-e83f4212e531 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:45.796302 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9ea34293-4513-4f70-b4fa-e83f4212e531 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:45.797153 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9ea34293-4513-4f70-b4fa-e83f4212e531 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:45.797585 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9ea34293-4513-4f70-b4fa-e83f4212e531 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:45.943680 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-9ea34293-4513-4f70-b4fa-e83f4212e531 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:14:45.952353 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9ea34293-4513-4f70-b4fa-e83f4212e531 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe" status: 200 len: 1548 microversion: 2.1 time: 0.174492 Jun 25 16:14:45.953258 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 426/846] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:14:45 2022] GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe => generated 1548 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:14:45.968565 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-3d1dd88d-b7e0-4a4d-8d29-6036ee5c1cc0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:14:45.969219 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-3d1dd88d-b7e0-4a4d-8d29-6036ee5c1cc0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: 2e42b781-8a83-4b8c-8499-46992761eafe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:14:45.977019 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3d1dd88d-b7e0-4a4d-8d29-6036ee5c1cc0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:45.977552 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3d1dd88d-b7e0-4a4d-8d29-6036ee5c1cc0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:45.978392 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3d1dd88d-b7e0-4a4d-8d29-6036ee5c1cc0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:45.978931 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3d1dd88d-b7e0-4a4d-8d29-6036ee5c1cc0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:46.065312 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-3d1dd88d-b7e0-4a4d-8d29-6036ee5c1cc0 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100497 Jun 25 16:14:46.065907 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 421/847] 10.222.0.13 () {58 vars in 1274 bytes} [Sat Jun 25 16:14:45 2022] GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:14:47.294442 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-b870ff2d-2ed0-44da-ad48-ecb424328ab2 req-b4a6851e-83ff-4e32-ba6f-09a62a32725f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e42b781-8a83-4b8c-8499-46992761eafe", "tag": "8035843a-a113-464b-9ba4-185653805a8d"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:14:47.297926 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=6 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:14:47.304512 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-b870ff2d-2ed0-44da-ad48-ecb424328ab2 req-b4a6851e-83ff-4e32-ba6f-09a62a32725f service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:47.304974 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-b870ff2d-2ed0-44da-ad48-ecb424328ab2 req-b4a6851e-83ff-4e32-ba6f-09a62a32725f service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:47.317968 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-b870ff2d-2ed0-44da-ad48-ecb424328ab2 req-b4a6851e-83ff-4e32-ba6f-09a62a32725f service nova] Creating event network-changed:8035843a-a113-464b-9ba4-185653805a8d for instance 2e42b781-8a83-4b8c-8499-46992761eafe on hv-cinder-84762 Jun 25 16:14:47.323050 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-b870ff2d-2ed0-44da-ad48-ecb424328ab2 req-b4a6851e-83ff-4e32-ba6f-09a62a32725f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032554 Jun 25 16:14:47.323948 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 427/848] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:14:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:14:56.584510 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell0:SELECT=2 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:14:56.585286 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell0:SELECT=6 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:14:56.586708 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_api:SELECT=38,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:14:56.587533 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=56 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:14:56.592265 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-64109170-cfce-4bcb-abb4-0cfe130aea05 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1053305732", "imageRef": "84c164fa-276d-4693-b7a0-24fd3024b359", "flavorRef": "452"}} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:14:56.645353 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.network.neutron [None req-64109170-cfce-4bcb-abb4-0cfe130aea05 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] validate_networks() for None {{(pid=117794) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 16:14:56.943737 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-64109170-cfce-4bcb-abb4-0cfe130aea05 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Flavor limits 0:0:0 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 16:14:56.944301 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-64109170-cfce-4bcb-abb4-0cfe130aea05 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Image limits 0:0:0 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 16:14:56.945048 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-64109170-cfce-4bcb-abb4-0cfe130aea05 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Flavor pref 0:0:0 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 16:14:56.945549 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-64109170-cfce-4bcb-abb4-0cfe130aea05 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Image pref 0:0:0 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 16:14:56.946079 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-64109170-cfce-4bcb-abb4-0cfe130aea05 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 16:14:56.957715 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-64109170-cfce-4bcb-abb4-0cfe130aea05 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:56.958170 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-64109170-cfce-4bcb-abb4-0cfe130aea05 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:56.958983 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-64109170-cfce-4bcb-abb4-0cfe130aea05 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:56.959422 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-64109170-cfce-4bcb-abb4-0cfe130aea05 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:56.977239 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.quota [None req-64109170-cfce-4bcb-abb4-0cfe130aea05 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Getting quotas for project 5d13640c8dcd49008d2f16313fd6e7ee. Resources: {'ram', 'cores', 'instances'} {{(pid=117794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:14:56.981820 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.quota [None req-64109170-cfce-4bcb-abb4-0cfe130aea05 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Getting quotas for user 03f1b99a0c3f42c08c5441b6311c450a and project 5d13640c8dcd49008d2f16313fd6e7ee. Resources: {'ram', 'cores', 'instances'} {{(pid=117794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:14:56.993046 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-64109170-cfce-4bcb-abb4-0cfe130aea05 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Going to run 1 instances... {{(pid=117794) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 16:14:56.995522 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-64109170-cfce-4bcb-abb4-0cfe130aea05 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] [instance: 129fed5a-52dd-4774-835a-3551dfc2c69f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='84c164fa-276d-4693-b7a0-24fd3024b359',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 16:14:57.043449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-64109170-cfce-4bcb-abb4-0cfe130aea05 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.459688 Jun 25 16:14:57.044114 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 422/849] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Jun 25 16:14:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 461 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 16:14:57.054689 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-af522562-496c-46a0-892d-102545f4ce31 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:14:57.055390 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-af522562-496c-46a0-892d-102545f4ce31 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] [instance: 129fed5a-52dd-4774-835a-3551dfc2c69f] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:14:57.108183 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-af522562-496c-46a0-892d-102545f4ce31 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f1b99a0c3f42c08c5441b6311c450a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d13640c8dcd49008d2f16313fd6e7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:14:57.115084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-af522562-496c-46a0-892d-102545f4ce31 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] 10.222.0.13 "GET /compute/v2.1/servers/129fed5a-52dd-4774-835a-3551dfc2c69f" status: 200 len: 1215 microversion: 2.1 time: 0.064443 Jun 25 16:14:57.115518 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 428/850] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:14:57 2022] GET /compute/v2.1/servers/129fed5a-52dd-4774-835a-3551dfc2c69f => generated 1215 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:14:58.131961 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-67335967-15e8-4b84-acc8-f757d71e8d44 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:14:58.132524 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-67335967-15e8-4b84-acc8-f757d71e8d44 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] [instance: 129fed5a-52dd-4774-835a-3551dfc2c69f] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:14:58.139724 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-67335967-15e8-4b84-acc8-f757d71e8d44 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:58.140175 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-67335967-15e8-4b84-acc8-f757d71e8d44 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:58.141040 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-67335967-15e8-4b84-acc8-f757d71e8d44 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:58.141419 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-67335967-15e8-4b84-acc8-f757d71e8d44 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:58.215099 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-67335967-15e8-4b84-acc8-f757d71e8d44 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f1b99a0c3f42c08c5441b6311c450a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d13640c8dcd49008d2f16313fd6e7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:14:58.222632 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-67335967-15e8-4b84-acc8-f757d71e8d44 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] 10.222.0.13 "GET /compute/v2.1/servers/129fed5a-52dd-4774-835a-3551dfc2c69f" status: 200 len: 1273 microversion: 2.1 time: 0.095302 Jun 25 16:14:58.223204 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 423/851] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:14:58 2022] GET /compute/v2.1/servers/129fed5a-52dd-4774-835a-3551dfc2c69f => generated 1273 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:14:59.239259 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-10a59f96-5998-4882-b671-2c2dcfc540c3 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:14:59.239975 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-10a59f96-5998-4882-b671-2c2dcfc540c3 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] [instance: 129fed5a-52dd-4774-835a-3551dfc2c69f] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:14:59.242114 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:14:59.243351 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:14:59.250629 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-10a59f96-5998-4882-b671-2c2dcfc540c3 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:59.251077 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-10a59f96-5998-4882-b671-2c2dcfc540c3 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:59.251840 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-10a59f96-5998-4882-b671-2c2dcfc540c3 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:59.252291 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-10a59f96-5998-4882-b671-2c2dcfc540c3 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:59.452593 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-10a59f96-5998-4882-b671-2c2dcfc540c3 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f1b99a0c3f42c08c5441b6311c450a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d13640c8dcd49008d2f16313fd6e7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:14:59.460329 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-10a59f96-5998-4882-b671-2c2dcfc540c3 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] 10.222.0.13 "GET /compute/v2.1/servers/129fed5a-52dd-4774-835a-3551dfc2c69f" status: 200 len: 1315 microversion: 2.1 time: 0.224969 Jun 25 16:14:59.460938 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 429/852] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:14:59 2022] GET /compute/v2.1/servers/129fed5a-52dd-4774-835a-3551dfc2c69f => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:14:59.561013 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-97e4c82e-fddd-4db9-9e0c-aa09e1e40a7b req-ddb40495-a3d7-4172-9f0a-bec1830db41b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "129fed5a-52dd-4774-835a-3551dfc2c69f", "tag": "a634ef3f-0d33-4dd9-b214-79780a026dc6"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:14:59.571090 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-97e4c82e-fddd-4db9-9e0c-aa09e1e40a7b req-ddb40495-a3d7-4172-9f0a-bec1830db41b service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:14:59.571990 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-97e4c82e-fddd-4db9-9e0c-aa09e1e40a7b req-ddb40495-a3d7-4172-9f0a-bec1830db41b service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:14:59.591102 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-97e4c82e-fddd-4db9-9e0c-aa09e1e40a7b req-ddb40495-a3d7-4172-9f0a-bec1830db41b service nova] Creating event network-changed:a634ef3f-0d33-4dd9-b214-79780a026dc6 for instance 129fed5a-52dd-4774-835a-3551dfc2c69f on hv-cinder-84762 Jun 25 16:14:59.597054 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-97e4c82e-fddd-4db9-9e0c-aa09e1e40a7b req-ddb40495-a3d7-4172-9f0a-bec1830db41b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039868 Jun 25 16:14:59.598341 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 424/853] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:14:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:15:00.481349 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-fb9f570f-38f7-41ad-974d-1654ee7dff01 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:00.482304 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-fb9f570f-38f7-41ad-974d-1654ee7dff01 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] [instance: 129fed5a-52dd-4774-835a-3551dfc2c69f] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:00.493271 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fb9f570f-38f7-41ad-974d-1654ee7dff01 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:00.494021 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fb9f570f-38f7-41ad-974d-1654ee7dff01 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:00.495180 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fb9f570f-38f7-41ad-974d-1654ee7dff01 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:00.495612 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-fb9f570f-38f7-41ad-974d-1654ee7dff01 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:00.642830 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-fb9f570f-38f7-41ad-974d-1654ee7dff01 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f1b99a0c3f42c08c5441b6311c450a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d13640c8dcd49008d2f16313fd6e7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:15:00.650355 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-fb9f570f-38f7-41ad-974d-1654ee7dff01 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] 10.222.0.13 "GET /compute/v2.1/servers/129fed5a-52dd-4774-835a-3551dfc2c69f" status: 200 len: 1315 microversion: 2.1 time: 0.175576 Jun 25 16:15:00.651053 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 430/854] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:15:00 2022] GET /compute/v2.1/servers/129fed5a-52dd-4774-835a-3551dfc2c69f => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:15:01.673813 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-835233ce-0755-4ae6-80f7-d45a29fc5887 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:01.674980 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-835233ce-0755-4ae6-80f7-d45a29fc5887 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] [instance: 129fed5a-52dd-4774-835a-3551dfc2c69f] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:01.685787 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-835233ce-0755-4ae6-80f7-d45a29fc5887 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:01.686536 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-835233ce-0755-4ae6-80f7-d45a29fc5887 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:01.687807 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-835233ce-0755-4ae6-80f7-d45a29fc5887 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:01.688574 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-835233ce-0755-4ae6-80f7-d45a29fc5887 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:01.835611 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-835233ce-0755-4ae6-80f7-d45a29fc5887 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f1b99a0c3f42c08c5441b6311c450a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d13640c8dcd49008d2f16313fd6e7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:15:01.843718 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-835233ce-0755-4ae6-80f7-d45a29fc5887 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] 10.222.0.13 "GET /compute/v2.1/servers/129fed5a-52dd-4774-835a-3551dfc2c69f" status: 200 len: 1315 microversion: 2.1 time: 0.178383 Jun 25 16:15:01.844287 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 425/855] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:15:01 2022] GET /compute/v2.1/servers/129fed5a-52dd-4774-835a-3551dfc2c69f => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:15:02.863056 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-bc0b8292-f293-486c-a985-1b3e3b6cc48a tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:02.863918 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-bc0b8292-f293-486c-a985-1b3e3b6cc48a tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] [instance: 129fed5a-52dd-4774-835a-3551dfc2c69f] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:02.872439 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bc0b8292-f293-486c-a985-1b3e3b6cc48a tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:02.872994 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bc0b8292-f293-486c-a985-1b3e3b6cc48a tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:02.873765 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bc0b8292-f293-486c-a985-1b3e3b6cc48a tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:02.874199 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bc0b8292-f293-486c-a985-1b3e3b6cc48a tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:03.012078 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-bc0b8292-f293-486c-a985-1b3e3b6cc48a tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f1b99a0c3f42c08c5441b6311c450a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d13640c8dcd49008d2f16313fd6e7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:15:03.020436 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-bc0b8292-f293-486c-a985-1b3e3b6cc48a tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] 10.222.0.13 "GET /compute/v2.1/servers/129fed5a-52dd-4774-835a-3551dfc2c69f" status: 200 len: 1315 microversion: 2.1 time: 0.162528 Jun 25 16:15:03.021023 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 431/856] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:15:02 2022] GET /compute/v2.1/servers/129fed5a-52dd-4774-835a-3551dfc2c69f => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:15:04.045572 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-3355f31e-9e8a-499b-8cd0-076a3c31e272 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:04.046370 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-3355f31e-9e8a-499b-8cd0-076a3c31e272 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] [instance: 129fed5a-52dd-4774-835a-3551dfc2c69f] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:04.054825 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3355f31e-9e8a-499b-8cd0-076a3c31e272 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:04.055397 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3355f31e-9e8a-499b-8cd0-076a3c31e272 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:04.056358 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3355f31e-9e8a-499b-8cd0-076a3c31e272 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:04.056988 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3355f31e-9e8a-499b-8cd0-076a3c31e272 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:04.204557 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-3355f31e-9e8a-499b-8cd0-076a3c31e272 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f1b99a0c3f42c08c5441b6311c450a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d13640c8dcd49008d2f16313fd6e7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:15:04.212193 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-3355f31e-9e8a-499b-8cd0-076a3c31e272 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] 10.222.0.13 "GET /compute/v2.1/servers/129fed5a-52dd-4774-835a-3551dfc2c69f" status: 200 len: 1315 microversion: 2.1 time: 0.172233 Jun 25 16:15:04.212808 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 426/857] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:15:04 2022] GET /compute/v2.1/servers/129fed5a-52dd-4774-835a-3551dfc2c69f => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:15:04.272302 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-654e0a1e-3059-43d9-a328-c2a4decfc987 req-a5c5a60e-6e7a-4855-bbfd-846e607c0b1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "129fed5a-52dd-4774-835a-3551dfc2c69f", "name": "network-vif-plugged", "status": "completed", "tag": "a634ef3f-0d33-4dd9-b214-79780a026dc6"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:15:04.281104 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-654e0a1e-3059-43d9-a328-c2a4decfc987 req-a5c5a60e-6e7a-4855-bbfd-846e607c0b1e service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:04.281548 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-654e0a1e-3059-43d9-a328-c2a4decfc987 req-a5c5a60e-6e7a-4855-bbfd-846e607c0b1e service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:04.293340 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-654e0a1e-3059-43d9-a328-c2a4decfc987 req-a5c5a60e-6e7a-4855-bbfd-846e607c0b1e service nova] Creating event network-vif-plugged:a634ef3f-0d33-4dd9-b214-79780a026dc6 for instance 129fed5a-52dd-4774-835a-3551dfc2c69f on hv-cinder-84762 Jun 25 16:15:04.298268 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-654e0a1e-3059-43d9-a328-c2a4decfc987 req-a5c5a60e-6e7a-4855-bbfd-846e607c0b1e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029739 Jun 25 16:15:04.298888 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 432/858] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:15:05.229570 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-d3228b2f-3573-4cf3-a58c-d8687d8aa0f7 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:05.230188 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-d3228b2f-3573-4cf3-a58c-d8687d8aa0f7 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] [instance: 129fed5a-52dd-4774-835a-3551dfc2c69f] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:05.237175 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d3228b2f-3573-4cf3-a58c-d8687d8aa0f7 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:05.237631 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d3228b2f-3573-4cf3-a58c-d8687d8aa0f7 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:05.238399 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d3228b2f-3573-4cf3-a58c-d8687d8aa0f7 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:05.238839 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d3228b2f-3573-4cf3-a58c-d8687d8aa0f7 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:05.372522 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d3228b2f-3573-4cf3-a58c-d8687d8aa0f7 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f1b99a0c3f42c08c5441b6311c450a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d13640c8dcd49008d2f16313fd6e7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:15:05.380122 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-d3228b2f-3573-4cf3-a58c-d8687d8aa0f7 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] 10.222.0.13 "GET /compute/v2.1/servers/129fed5a-52dd-4774-835a-3551dfc2c69f" status: 200 len: 1315 microversion: 2.1 time: 0.154665 Jun 25 16:15:05.380719 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 427/859] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:15:05 2022] GET /compute/v2.1/servers/129fed5a-52dd-4774-835a-3551dfc2c69f => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:15:06.402799 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b169ff89-9375-471c-86ea-403621a44dfc tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:06.403447 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b169ff89-9375-471c-86ea-403621a44dfc tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] [instance: 129fed5a-52dd-4774-835a-3551dfc2c69f] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:06.410827 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b169ff89-9375-471c-86ea-403621a44dfc tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:06.411317 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b169ff89-9375-471c-86ea-403621a44dfc tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:06.412155 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b169ff89-9375-471c-86ea-403621a44dfc tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:06.412672 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b169ff89-9375-471c-86ea-403621a44dfc tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:06.558288 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b169ff89-9375-471c-86ea-403621a44dfc tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f1b99a0c3f42c08c5441b6311c450a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d13640c8dcd49008d2f16313fd6e7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:15:06.566373 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b169ff89-9375-471c-86ea-403621a44dfc tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] 10.222.0.13 "GET /compute/v2.1/servers/129fed5a-52dd-4774-835a-3551dfc2c69f" status: 200 len: 1465 microversion: 2.1 time: 0.171127 Jun 25 16:15:06.566965 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 433/860] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:15:06 2022] GET /compute/v2.1/servers/129fed5a-52dd-4774-835a-3551dfc2c69f => generated 1465 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:15:06.612978 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-22d02253-0ef4-4d2e-9b50-031f137212fc tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:06.613489 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-22d02253-0ef4-4d2e-9b50-031f137212fc tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] [instance: 129fed5a-52dd-4774-835a-3551dfc2c69f] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:06.620393 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-22d02253-0ef4-4d2e-9b50-031f137212fc tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:06.620880 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-22d02253-0ef4-4d2e-9b50-031f137212fc tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:06.621640 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-22d02253-0ef4-4d2e-9b50-031f137212fc tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:06.622070 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-22d02253-0ef4-4d2e-9b50-031f137212fc tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:06.649356 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-22d02253-0ef4-4d2e-9b50-031f137212fc tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] [instance: 129fed5a-52dd-4774-835a-3551dfc2c69f] Going to try to terminate instance {{(pid=117794) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 16:15:06.734135 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-22d02253-0ef4-4d2e-9b50-031f137212fc tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] 10.222.0.13 "DELETE /compute/v2.1/servers/129fed5a-52dd-4774-835a-3551dfc2c69f" status: 204 len: 0 microversion: 2.1 time: 0.124794 Jun 25 16:15:06.734722 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 428/861] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Jun 25 16:15:06 2022] DELETE /compute/v2.1/servers/129fed5a-52dd-4774-835a-3551dfc2c69f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 16:15:06.742938 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1982408d-9301-4be6-8063-9d3e63d1d9c6 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:06.743537 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1982408d-9301-4be6-8063-9d3e63d1d9c6 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] [instance: 129fed5a-52dd-4774-835a-3551dfc2c69f] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:06.749727 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1982408d-9301-4be6-8063-9d3e63d1d9c6 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:06.750173 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1982408d-9301-4be6-8063-9d3e63d1d9c6 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:06.750924 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1982408d-9301-4be6-8063-9d3e63d1d9c6 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:06.751351 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1982408d-9301-4be6-8063-9d3e63d1d9c6 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:06.894965 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1982408d-9301-4be6-8063-9d3e63d1d9c6 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f1b99a0c3f42c08c5441b6311c450a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d13640c8dcd49008d2f16313fd6e7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:15:06.902927 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1982408d-9301-4be6-8063-9d3e63d1d9c6 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] 10.222.0.13 "GET /compute/v2.1/servers/129fed5a-52dd-4774-835a-3551dfc2c69f" status: 200 len: 1471 microversion: 2.1 time: 0.163803 Jun 25 16:15:06.903507 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 434/862] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:15:06 2022] GET /compute/v2.1/servers/129fed5a-52dd-4774-835a-3551dfc2c69f => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:15:07.925298 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-358143bb-bd50-4cd9-9f3c-7322660de307 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:07.926441 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-358143bb-bd50-4cd9-9f3c-7322660de307 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] [instance: 129fed5a-52dd-4774-835a-3551dfc2c69f] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:07.929521 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell0:SELECT=2 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:15:07.930734 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell0:SELECT=6 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:15:07.938767 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-358143bb-bd50-4cd9-9f3c-7322660de307 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:07.939228 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-358143bb-bd50-4cd9-9f3c-7322660de307 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:07.939974 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-358143bb-bd50-4cd9-9f3c-7322660de307 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:07.940402 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-358143bb-bd50-4cd9-9f3c-7322660de307 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:08.073889 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-358143bb-bd50-4cd9-9f3c-7322660de307 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '03f1b99a0c3f42c08c5441b6311c450a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d13640c8dcd49008d2f16313fd6e7ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:15:08.081739 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-358143bb-bd50-4cd9-9f3c-7322660de307 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] 10.222.0.13 "GET /compute/v2.1/servers/129fed5a-52dd-4774-835a-3551dfc2c69f" status: 200 len: 1471 microversion: 2.1 time: 0.163604 Jun 25 16:15:08.082306 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 429/863] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:15:07 2022] GET /compute/v2.1/servers/129fed5a-52dd-4774-835a-3551dfc2c69f => generated 1471 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:15:08.593946 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-e8879194-87c2-453e-b427-7e443b40076d req-66ee36c6-8198-4958-b494-684b9be2a05e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "129fed5a-52dd-4774-835a-3551dfc2c69f", "name": "network-vif-deleted", "tag": "a634ef3f-0d33-4dd9-b214-79780a026dc6"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:15:08.598941 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:15:08.606588 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e8879194-87c2-453e-b427-7e443b40076d req-66ee36c6-8198-4958-b494-684b9be2a05e service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:08.607028 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-e8879194-87c2-453e-b427-7e443b40076d req-66ee36c6-8198-4958-b494-684b9be2a05e service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:08.618936 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-e8879194-87c2-453e-b427-7e443b40076d req-66ee36c6-8198-4958-b494-684b9be2a05e service nova] Creating event network-vif-deleted:a634ef3f-0d33-4dd9-b214-79780a026dc6 for instance 129fed5a-52dd-4774-835a-3551dfc2c69f on hv-cinder-84762 Jun 25 16:15:08.624397 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-e8879194-87c2-453e-b427-7e443b40076d req-66ee36c6-8198-4958-b494-684b9be2a05e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034264 Jun 25 16:15:08.625045 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 435/864] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:15:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:15:09.099275 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-9299d372-fdf2-4531-bd9d-f1ef814c7e27 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:09.099899 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-9299d372-fdf2-4531-bd9d-f1ef814c7e27 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] [instance: 129fed5a-52dd-4774-835a-3551dfc2c69f] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:09.106551 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9299d372-fdf2-4531-bd9d-f1ef814c7e27 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:09.106999 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9299d372-fdf2-4531-bd9d-f1ef814c7e27 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:09.107751 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9299d372-fdf2-4531-bd9d-f1ef814c7e27 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:09.108180 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9299d372-fdf2-4531-bd9d-f1ef814c7e27 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:09.121572 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.wsgi [None req-9299d372-fdf2-4531-bd9d-f1ef814c7e27 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] HTTP exception thrown: Instance 129fed5a-52dd-4774-835a-3551dfc2c69f could not be found. Jun 25 16:15:09.123198 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-9299d372-fdf2-4531-bd9d-f1ef814c7e27 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Request method failure captured: Jun 25 16:15:09.123198 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: request: GET /compute/v2.1/servers/129fed5a-52dd-4774-835a-3551dfc2c69f HTTP/1.1 Jun 25 16:15:09.123198 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept: application/json Jun 25 16:15:09.123198 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept-Encoding: identity Jun 25 16:15:09.123198 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Connection: close Jun 25 16:15:09.123198 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Length: 0 Jun 25 16:15:09.123198 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Type: application/json Jun 25 16:15:09.123198 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Host: 10.222.0.13 Jun 25 16:15:09.123198 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Openstack-System-Scope: None Jun 25 16:15:09.123198 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: User-Agent: python-urllib3/1.26.9 Jun 25 16:15:09.123198 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Auth-Token: gAAAAABitzR_WkewmdHWXdAEgQwgWBR_sLYxonH-G7RRBUepJsg4HcVGJNlS5UKSJAmYHUg4tlB0IQgqS0VGXsZCspYRPixeBI_5MUhR69WSK9Oo1hCT3NC8ewdIYr-Dtk1-LYheMwU0DXOoVtVyJTUJUDzzfDIRocf_rxW3CuiCKwvoA5K4udc Jun 25 16:15:09.123198 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Id: None Jun 25 16:15:09.123198 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Name: None Jun 25 16:15:09.123198 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Identity-Status: Confirmed Jun 25 16:15:09.123198 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Is-Admin-Project: True Jun 25 16:15:09.123198 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Id: default Jun 25 16:15:09.123198 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Name: Default Jun 25 16:15:09.123198 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Id: 5d13640c8dcd49008d2f16313fd6e7ee Jun 25 16:15:09.123198 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Name: tempest-VolumesNegativeTest-1269696062 Jun 25 16:15:09.123198 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Role: reader,member Jun 25 16:15:09.123198 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Roles: reader,member Jun 25 16:15:09.124814 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5d13640c8dcd49008d2f16313fd6e7ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5d13640c8dcd49008d2f16313fd6e7ee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5d13640c8dcd49008d2f16313fd6e7ee", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5d13640c8dcd49008d2f16313fd6e7ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:15:09.124814 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant: tempest-VolumesNegativeTest-1269696062 Jun 25 16:15:09.124814 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Id: 5d13640c8dcd49008d2f16313fd6e7ee Jun 25 16:15:09.124814 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Name: tempest-VolumesNegativeTest-1269696062 Jun 25 16:15:09.124814 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User: tempest-VolumesNegativeTest-1269696062-project Jun 25 16:15:09.124814 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Id: default Jun 25 16:15:09.124814 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Name: Default Jun 25 16:15:09.124814 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Id: 03f1b99a0c3f42c08c5441b6311c450a Jun 25 16:15:09.124814 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Name: tempest-VolumesNegativeTest-1269696062-project Jun 25 16:15:09.124814 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: method: > Jun 25 16:15:09.124814 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: exception: Instance 129fed5a-52dd-4774-835a-3551dfc2c69f could not be found. Jun 25 16:15:09.124814 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: action_args: {'id': '129fed5a-52dd-4774-835a-3551dfc2c69f'} Jun 25 16:15:09.125673 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:15:09.125673 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:09.125673 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:15:09.125673 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:15:09.125673 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:15:09.125673 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:15:09.125673 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:15:09.125673 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:15:09.125673 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:15:09.125673 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:15:09.125673 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 129fed5a-52dd-4774-835a-3551dfc2c69f could not be found. Jun 25 16:15:09.125673 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:09.125673 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:15:09.125673 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:09.125673 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:09.125673 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:15:09.125673 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:15:09.125673 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:15:09.125673 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:15:09.125673 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:15:09.126952 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:15:09.126952 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 16:15:09.126952 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 16:15:09.126952 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:15:09.126952 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:15:09.126952 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:15:09.126952 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:15:09.126952 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 129fed5a-52dd-4774-835a-3551dfc2c69f could not be found. Jun 25 16:15:09.126952 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:09.126952 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:15:09.126952 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:09.126952 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:09.126952 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:15:09.126952 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:15:09.126952 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:15:09.126952 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:15:09.126952 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 129fed5a-52dd-4774-835a-3551dfc2c69f could not be found. Jun 25 16:15:09.126952 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:09.128163 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-9299d372-fdf2-4531-bd9d-f1ef814c7e27 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] Returning 404 to user: Instance 129fed5a-52dd-4774-835a-3551dfc2c69f could not be found. {{(pid=117794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:15:09.128163 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-9299d372-fdf2-4531-bd9d-f1ef814c7e27 tempest-VolumesNegativeTest-1269696062 tempest-VolumesNegativeTest-1269696062-project] 10.222.0.13 "GET /compute/v2.1/servers/129fed5a-52dd-4774-835a-3551dfc2c69f" status: 404 len: 111 microversion: 2.1 time: 0.029202 Jun 25 16:15:09.128163 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 430/865] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:15:09 2022] GET /compute/v2.1/servers/129fed5a-52dd-4774-835a-3551dfc2c69f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:15:23.248910 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=13 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:15:23.249760 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=34 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:15:23.254233 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-579a9bd7-baa7-4060-bf0d-ed83365a1d2e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:23.254819 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-579a9bd7-baa7-4060-bf0d-ed83365a1d2e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: 2e42b781-8a83-4b8c-8499-46992761eafe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:23.262948 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-579a9bd7-baa7-4060-bf0d-ed83365a1d2e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:23.263394 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-579a9bd7-baa7-4060-bf0d-ed83365a1d2e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:23.264491 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-579a9bd7-baa7-4060-bf0d-ed83365a1d2e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:23.264926 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-579a9bd7-baa7-4060-bf0d-ed83365a1d2e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:23.289508 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-579a9bd7-baa7-4060-bf0d-ed83365a1d2e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe/ips" status: 200 len: 145 microversion: 2.1 time: 0.043040 Jun 25 16:15:23.290072 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 436/866] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Jun 25 16:15:23 2022] GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe/ips => generated 145 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:15:24.635233 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-d4ceb25d-dfc0-488c-b68d-1c775617d4e4 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a4524e5c-602d-4be3-bf23-536ccff071c8"}} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:15:24.636675 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-d4ceb25d-dfc0-488c-b68d-1c775617d4e4 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: 2e42b781-8a83-4b8c-8499-46992761eafe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:24.640090 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:15:24.640767 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:15:24.648904 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d4ceb25d-dfc0-488c-b68d-1c775617d4e4 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:24.649502 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d4ceb25d-dfc0-488c-b68d-1c775617d4e4 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:24.650624 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d4ceb25d-dfc0-488c-b68d-1c775617d4e4 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:24.651058 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d4ceb25d-dfc0-488c-b68d-1c775617d4e4 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:24.903349 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-d4ceb25d-dfc0-488c-b68d-1c775617d4e4 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "POST /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274541 Jun 25 16:15:24.903991 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 431/867] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Jun 25 16:15:24 2022] POST /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:15:31.411178 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-90a89844-f3ff-4230-87ac-94fabe4b0c07 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:31.412138 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-90a89844-f3ff-4230-87ac-94fabe4b0c07 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: 2e42b781-8a83-4b8c-8499-46992761eafe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:31.419475 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-90a89844-f3ff-4230-87ac-94fabe4b0c07 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:31.419921 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-90a89844-f3ff-4230-87ac-94fabe4b0c07 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:31.420719 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-90a89844-f3ff-4230-87ac-94fabe4b0c07 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:31.421158 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-90a89844-f3ff-4230-87ac-94fabe4b0c07 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:31.451722 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-90a89844-f3ff-4230-87ac-94fabe4b0c07 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044547 Jun 25 16:15:31.452269 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 437/868] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Jun 25 16:15:31 2022] GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:15:31.466653 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-2e61fd35-8ee7-450a-a881-93b5adcc83e5 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:31.467228 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-2e61fd35-8ee7-450a-a881-93b5adcc83e5 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: 2e42b781-8a83-4b8c-8499-46992761eafe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:31.473947 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2e61fd35-8ee7-450a-a881-93b5adcc83e5 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:31.474400 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2e61fd35-8ee7-450a-a881-93b5adcc83e5 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:31.475172 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2e61fd35-8ee7-450a-a881-93b5adcc83e5 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:31.475615 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2e61fd35-8ee7-450a-a881-93b5adcc83e5 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:31.504340 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-2e61fd35-8ee7-450a-a881-93b5adcc83e5 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe/os-volume_attachments/a4524e5c-602d-4be3-bf23-536ccff071c8" status: 200 len: 194 microversion: 2.1 time: 0.042620 Jun 25 16:15:31.504945 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 432/869] 10.222.0.13 () {58 vars in 1412 bytes} [Sat Jun 25 16:15:31 2022] GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe/os-volume_attachments/a4524e5c-602d-4be3-bf23-536ccff071c8 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:15:32.861910 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-12559bb4-190b-46c0-97ed-2c966d91a374 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c2aae612-a9a3-47ab-b903-ac4dc2ff925e"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:15:32.863217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-12559bb4-190b-46c0-97ed-2c966d91a374 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: 2e42b781-8a83-4b8c-8499-46992761eafe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:32.869699 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-12559bb4-190b-46c0-97ed-2c966d91a374 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:32.870142 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-12559bb4-190b-46c0-97ed-2c966d91a374 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:32.870903 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-12559bb4-190b-46c0-97ed-2c966d91a374 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:32.871340 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-12559bb4-190b-46c0-97ed-2c966d91a374 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:33.127340 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-12559bb4-190b-46c0-97ed-2c966d91a374 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "POST /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269166 Jun 25 16:15:33.127977 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 438/870] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Jun 25 16:15:32 2022] POST /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:15:40.666362 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-b35fe5a5-9fa9-4233-a9ef-c172f9decb38 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:40.667288 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-b35fe5a5-9fa9-4233-a9ef-c172f9decb38 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: 2e42b781-8a83-4b8c-8499-46992761eafe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:40.674511 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b35fe5a5-9fa9-4233-a9ef-c172f9decb38 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:40.674966 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b35fe5a5-9fa9-4233-a9ef-c172f9decb38 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:40.675732 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b35fe5a5-9fa9-4233-a9ef-c172f9decb38 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:40.676167 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b35fe5a5-9fa9-4233-a9ef-c172f9decb38 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:40.707101 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-b35fe5a5-9fa9-4233-a9ef-c172f9decb38 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044791 Jun 25 16:15:40.707643 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 433/871] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Jun 25 16:15:40 2022] GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:15:40.860590 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a8cdd9a2-0448-4b6b-9132-5c5e100a806e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:40.861368 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a8cdd9a2-0448-4b6b-9132-5c5e100a806e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: 2e42b781-8a83-4b8c-8499-46992761eafe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:40.870779 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a8cdd9a2-0448-4b6b-9132-5c5e100a806e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:40.871223 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a8cdd9a2-0448-4b6b-9132-5c5e100a806e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:40.871995 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a8cdd9a2-0448-4b6b-9132-5c5e100a806e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:40.872451 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a8cdd9a2-0448-4b6b-9132-5c5e100a806e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:40.903483 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a8cdd9a2-0448-4b6b-9132-5c5e100a806e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe/os-volume_attachments/a4524e5c-602d-4be3-bf23-536ccff071c8" status: 200 len: 194 microversion: 2.1 time: 0.051313 Jun 25 16:15:40.904071 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 439/872] 10.222.0.13 () {58 vars in 1412 bytes} [Sat Jun 25 16:15:40 2022] GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe/os-volume_attachments/a4524e5c-602d-4be3-bf23-536ccff071c8 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:15:40.914003 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-7232eaa0-e3e0-429e-82d6-650dafeed7f3 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:40.914531 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-7232eaa0-e3e0-429e-82d6-650dafeed7f3 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: 2e42b781-8a83-4b8c-8499-46992761eafe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:40.921605 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7232eaa0-e3e0-429e-82d6-650dafeed7f3 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:40.922056 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7232eaa0-e3e0-429e-82d6-650dafeed7f3 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:40.922878 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7232eaa0-e3e0-429e-82d6-650dafeed7f3 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:40.923339 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-7232eaa0-e3e0-429e-82d6-650dafeed7f3 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:41.007667 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.objects.instance [None req-7232eaa0-e3e0-429e-82d6-650dafeed7f3 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lazy-loading 'services' on Instance uuid 2e42b781-8a83-4b8c-8499-46992761eafe {{(pid=117794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 16:15:41.096834 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-7232eaa0-e3e0-429e-82d6-650dafeed7f3 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe/os-volume_attachments/a4524e5c-602d-4be3-bf23-536ccff071c8" status: 202 len: 0 microversion: 2.1 time: 0.186514 Jun 25 16:15:41.097491 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 434/873] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Jun 25 16:15:40 2022] DELETE /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe/os-volume_attachments/a4524e5c-602d-4be3-bf23-536ccff071c8 => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 16:15:42.217809 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a4ac4f69-2a6e-4c98-9fd4-17b40e80c667 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:42.218348 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a4ac4f69-2a6e-4c98-9fd4-17b40e80c667 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: 2e42b781-8a83-4b8c-8499-46992761eafe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:42.228239 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a4ac4f69-2a6e-4c98-9fd4-17b40e80c667 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:42.228725 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a4ac4f69-2a6e-4c98-9fd4-17b40e80c667 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:42.229464 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a4ac4f69-2a6e-4c98-9fd4-17b40e80c667 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:42.229890 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a4ac4f69-2a6e-4c98-9fd4-17b40e80c667 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:42.257655 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a4ac4f69-2a6e-4c98-9fd4-17b40e80c667 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe/os-volume_attachments/c2aae612-a9a3-47ab-b903-ac4dc2ff925e" status: 200 len: 194 microversion: 2.1 time: 0.046743 Jun 25 16:15:42.258256 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 440/874] 10.222.0.13 () {58 vars in 1412 bytes} [Sat Jun 25 16:15:42 2022] GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe/os-volume_attachments/c2aae612-a9a3-47ab-b903-ac4dc2ff925e => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:15:42.275159 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-e2e59ab0-33e2-4919-acb3-82c4a7d3ca2e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:42.276215 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-e2e59ab0-33e2-4919-acb3-82c4a7d3ca2e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: 2e42b781-8a83-4b8c-8499-46992761eafe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:42.285836 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e2e59ab0-33e2-4919-acb3-82c4a7d3ca2e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:42.286522 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e2e59ab0-33e2-4919-acb3-82c4a7d3ca2e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:42.287728 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e2e59ab0-33e2-4919-acb3-82c4a7d3ca2e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:42.288341 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e2e59ab0-33e2-4919-acb3-82c4a7d3ca2e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:42.530087 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.objects.instance [None req-e2e59ab0-33e2-4919-acb3-82c4a7d3ca2e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lazy-loading 'services' on Instance uuid 2e42b781-8a83-4b8c-8499-46992761eafe {{(pid=117794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 16:15:42.604024 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-e2e59ab0-33e2-4919-acb3-82c4a7d3ca2e tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe/os-volume_attachments/c2aae612-a9a3-47ab-b903-ac4dc2ff925e" status: 202 len: 0 microversion: 2.1 time: 0.336195 Jun 25 16:15:42.604843 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 435/875] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Jun 25 16:15:42 2022] DELETE /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe/os-volume_attachments/c2aae612-a9a3-47ab-b903-ac4dc2ff925e => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 16:15:43.779549 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f24dd328-1823-44be-86c9-f57c7d3c6e80 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:43.780556 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f24dd328-1823-44be-86c9-f57c7d3c6e80 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: 2e42b781-8a83-4b8c-8499-46992761eafe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:43.787569 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f24dd328-1823-44be-86c9-f57c7d3c6e80 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:43.788017 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f24dd328-1823-44be-86c9-f57c7d3c6e80 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:43.788804 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f24dd328-1823-44be-86c9-f57c7d3c6e80 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:43.789229 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f24dd328-1823-44be-86c9-f57c7d3c6e80 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:43.819711 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f24dd328-1823-44be-86c9-f57c7d3c6e80 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044103 Jun 25 16:15:43.820260 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 441/876] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Jun 25 16:15:43 2022] GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 16:15:43.928278 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-608fca31-7b07-433c-bf00-4b98f24210cd tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:43.929314 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-608fca31-7b07-433c-bf00-4b98f24210cd tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: 2e42b781-8a83-4b8c-8499-46992761eafe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:43.936248 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-608fca31-7b07-433c-bf00-4b98f24210cd tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:43.936732 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-608fca31-7b07-433c-bf00-4b98f24210cd tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:43.937499 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-608fca31-7b07-433c-bf00-4b98f24210cd tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:43.937938 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-608fca31-7b07-433c-bf00-4b98f24210cd tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:43.967051 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-608fca31-7b07-433c-bf00-4b98f24210cd tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043582 Jun 25 16:15:43.967573 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 436/877] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Jun 25 16:15:43 2022] GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 16:15:44.023903 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-eccaa0ce-775d-438c-a8ff-86abff1f4511 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:44.024394 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-eccaa0ce-775d-438c-a8ff-86abff1f4511 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: 2e42b781-8a83-4b8c-8499-46992761eafe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:44.030835 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-eccaa0ce-775d-438c-a8ff-86abff1f4511 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:44.031281 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-eccaa0ce-775d-438c-a8ff-86abff1f4511 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:44.032037 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-eccaa0ce-775d-438c-a8ff-86abff1f4511 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:44.032565 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-eccaa0ce-775d-438c-a8ff-86abff1f4511 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:44.056880 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-eccaa0ce-775d-438c-a8ff-86abff1f4511 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: 2e42b781-8a83-4b8c-8499-46992761eafe] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 16:15:44.141549 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-eccaa0ce-775d-438c-a8ff-86abff1f4511 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe" status: 204 len: 0 microversion: 2.1 time: 0.121230 Jun 25 16:15:44.142599 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 442/878] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Jun 25 16:15:44 2022] DELETE /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 16:15:44.150541 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-20d8280a-3e03-4ae7-934b-bb47d7261336 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:44.151144 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-20d8280a-3e03-4ae7-934b-bb47d7261336 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: 2e42b781-8a83-4b8c-8499-46992761eafe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:44.157939 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-20d8280a-3e03-4ae7-934b-bb47d7261336 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:44.158384 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-20d8280a-3e03-4ae7-934b-bb47d7261336 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:44.159197 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-20d8280a-3e03-4ae7-934b-bb47d7261336 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:44.159627 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-20d8280a-3e03-4ae7-934b-bb47d7261336 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:44.303529 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-20d8280a-3e03-4ae7-934b-bb47d7261336 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:15:44.311902 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-20d8280a-3e03-4ae7-934b-bb47d7261336 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe" status: 200 len: 1672 microversion: 2.1 time: 0.165307 Jun 25 16:15:44.312464 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 437/879] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:15:44 2022] GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:15:45.334597 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-dee07654-8255-4c5d-b204-eb908ba164ad tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:45.335777 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-dee07654-8255-4c5d-b204-eb908ba164ad tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: 2e42b781-8a83-4b8c-8499-46992761eafe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:45.343837 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dee07654-8255-4c5d-b204-eb908ba164ad tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:45.344324 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dee07654-8255-4c5d-b204-eb908ba164ad tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:45.345114 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dee07654-8255-4c5d-b204-eb908ba164ad tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:45.345540 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-dee07654-8255-4c5d-b204-eb908ba164ad tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:45.481146 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-dee07654-8255-4c5d-b204-eb908ba164ad tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:15:45.489053 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-dee07654-8255-4c5d-b204-eb908ba164ad tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe" status: 200 len: 1672 microversion: 2.1 time: 0.161744 Jun 25 16:15:45.489610 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 443/880] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:15:45 2022] GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:15:46.509351 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-f0c06d88-2c14-4ab5-9a3f-b3c6ef598efb tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:46.510088 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-f0c06d88-2c14-4ab5-9a3f-b3c6ef598efb tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: 2e42b781-8a83-4b8c-8499-46992761eafe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:46.517398 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f0c06d88-2c14-4ab5-9a3f-b3c6ef598efb tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:46.517857 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f0c06d88-2c14-4ab5-9a3f-b3c6ef598efb tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:46.518694 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f0c06d88-2c14-4ab5-9a3f-b3c6ef598efb tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:46.519136 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f0c06d88-2c14-4ab5-9a3f-b3c6ef598efb tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:46.590134 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-f0c06d88-2c14-4ab5-9a3f-b3c6ef598efb tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5c2141524dc546259cd993ace59e33f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93ca9301bea041ce881109c706904a0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:15:46.598448 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-f0c06d88-2c14-4ab5-9a3f-b3c6ef598efb tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe" status: 200 len: 1605 microversion: 2.1 time: 0.095364 Jun 25 16:15:46.599136 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 438/881] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:15:46 2022] GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe => generated 1605 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:15:46.640114 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-fc84f1cb-4266-4cff-892b-676b6d6ee9f6 req-7d97d0dd-a456-49c1-9f7d-d2ced55e5a17 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e42b781-8a83-4b8c-8499-46992761eafe", "name": "network-vif-deleted", "tag": "8035843a-a113-464b-9ba4-185653805a8d"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:15:46.654657 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-fc84f1cb-4266-4cff-892b-676b6d6ee9f6 req-7d97d0dd-a456-49c1-9f7d-d2ced55e5a17 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:46.658879 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-fc84f1cb-4266-4cff-892b-676b6d6ee9f6 req-7d97d0dd-a456-49c1-9f7d-d2ced55e5a17 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:46.673632 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-fc84f1cb-4266-4cff-892b-676b6d6ee9f6 req-7d97d0dd-a456-49c1-9f7d-d2ced55e5a17 service nova] Creating event network-vif-deleted:8035843a-a113-464b-9ba4-185653805a8d for instance 2e42b781-8a83-4b8c-8499-46992761eafe on hv-cinder-84762 Jun 25 16:15:46.678642 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-fc84f1cb-4266-4cff-892b-676b6d6ee9f6 req-7d97d0dd-a456-49c1-9f7d-d2ced55e5a17 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044124 Jun 25 16:15:46.679671 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 444/882] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:15:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:15:47.615891 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-efe3df45-11d5-4fee-93f5-888d886ef58c tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:47.616629 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-efe3df45-11d5-4fee-93f5-888d886ef58c tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: 2e42b781-8a83-4b8c-8499-46992761eafe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:47.623319 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-efe3df45-11d5-4fee-93f5-888d886ef58c tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:47.623775 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-efe3df45-11d5-4fee-93f5-888d886ef58c tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:47.624578 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-efe3df45-11d5-4fee-93f5-888d886ef58c tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:47.625019 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-efe3df45-11d5-4fee-93f5-888d886ef58c tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:47.638243 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.wsgi [None req-efe3df45-11d5-4fee-93f5-888d886ef58c tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] HTTP exception thrown: Instance 2e42b781-8a83-4b8c-8499-46992761eafe could not be found. Jun 25 16:15:47.640208 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-efe3df45-11d5-4fee-93f5-888d886ef58c tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Request method failure captured: Jun 25 16:15:47.640208 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: request: GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe HTTP/1.1 Jun 25 16:15:47.640208 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept: application/json Jun 25 16:15:47.640208 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept-Encoding: identity Jun 25 16:15:47.640208 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Connection: close Jun 25 16:15:47.640208 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Length: 0 Jun 25 16:15:47.640208 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Type: application/json Jun 25 16:15:47.640208 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Host: 10.222.0.13 Jun 25 16:15:47.640208 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Openstack-System-Scope: None Jun 25 16:15:47.640208 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: User-Agent: python-urllib3/1.26.9 Jun 25 16:15:47.640208 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Auth-Token: gAAAAABitzO-OK9jhEcDWyxqOa8K-5Le5kJKq_SsM4XXokc7VVmoPPd-42rHpgqLb-hZ2UQvDe9jcgPLvsz3UPtKOnJuq8JVcsXwBOgCF4l9qa3QXae1V1RlJSU2e3mJLgHcfBWdkdqzMQRNBtqwcGpODk_8Vj3wdrBfuly72pvE_y1gMlL8jlA Jun 25 16:15:47.640208 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Id: None Jun 25 16:15:47.640208 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Name: None Jun 25 16:15:47.640208 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Identity-Status: Confirmed Jun 25 16:15:47.640208 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Is-Admin-Project: True Jun 25 16:15:47.640208 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Id: default Jun 25 16:15:47.640208 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Name: Default Jun 25 16:15:47.640208 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Id: 93ca9301bea041ce881109c706904a0a Jun 25 16:15:47.640208 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Name: tempest-AttachVolumeTestJSON-1792173987 Jun 25 16:15:47.640208 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Role: reader,member Jun 25 16:15:47.640208 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Roles: reader,member Jun 25 16:15:47.641863 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/93ca9301bea041ce881109c706904a0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/93ca9301bea041ce881109c706904a0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_93ca9301bea041ce881109c706904a0a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/93ca9301bea041ce881109c706904a0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:15:47.641863 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant: tempest-AttachVolumeTestJSON-1792173987 Jun 25 16:15:47.641863 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Id: 93ca9301bea041ce881109c706904a0a Jun 25 16:15:47.641863 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1792173987 Jun 25 16:15:47.641863 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User: tempest-AttachVolumeTestJSON-1792173987-project Jun 25 16:15:47.641863 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Id: default Jun 25 16:15:47.641863 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Name: Default Jun 25 16:15:47.641863 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Id: 5c2141524dc546259cd993ace59e33f3 Jun 25 16:15:47.641863 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Name: tempest-AttachVolumeTestJSON-1792173987-project Jun 25 16:15:47.641863 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: method: > Jun 25 16:15:47.641863 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: exception: Instance 2e42b781-8a83-4b8c-8499-46992761eafe could not be found. Jun 25 16:15:47.641863 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: action_args: {'id': '2e42b781-8a83-4b8c-8499-46992761eafe'} Jun 25 16:15:47.642877 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:15:47.642877 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:47.642877 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:15:47.642877 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:15:47.642877 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:15:47.642877 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:15:47.642877 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:15:47.642877 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:15:47.642877 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:15:47.642877 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:15:47.642877 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e42b781-8a83-4b8c-8499-46992761eafe could not be found. Jun 25 16:15:47.642877 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:47.642877 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:15:47.642877 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:47.642877 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:47.642877 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:15:47.642877 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:15:47.642877 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:15:47.642877 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:15:47.642877 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:15:47.644471 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:15:47.644471 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 16:15:47.644471 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 16:15:47.644471 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:15:47.644471 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:15:47.644471 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:15:47.644471 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:15:47.644471 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e42b781-8a83-4b8c-8499-46992761eafe could not be found. Jun 25 16:15:47.644471 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:47.644471 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:15:47.644471 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:47.644471 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:47.644471 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:15:47.644471 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:15:47.644471 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:15:47.644471 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:15:47.644471 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e42b781-8a83-4b8c-8499-46992761eafe could not be found. Jun 25 16:15:47.644471 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:47.646051 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-efe3df45-11d5-4fee-93f5-888d886ef58c tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Returning 404 to user: Instance 2e42b781-8a83-4b8c-8499-46992761eafe could not be found. {{(pid=117794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:15:47.646051 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-efe3df45-11d5-4fee-93f5-888d886ef58c tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe" status: 404 len: 111 microversion: 2.1 time: 0.029851 Jun 25 16:15:47.646051 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 439/883] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:15:47 2022] GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:15:47.654143 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-bcf68e62-d939-40c9-8bdc-4e6d05b8c61a tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '.version_select at 0x7f65bb4e0700>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:47.673823 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-bcf68e62-d939-40c9-8bdc-4e6d05b8c61a tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-469763489" status: 202 len: 0 microversion: 2.1 time: 0.024464 Jun 25 16:15:47.674415 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 445/884] 10.222.0.13 () {58 vars in 1217 bytes} [Sat Jun 25 16:15:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-469763489 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 16:15:50.591772 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-9df09c43-66f2-4938-89ba-0e3298e3f821 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:50.592350 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-9df09c43-66f2-4938-89ba-0e3298e3f821 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: 2e42b781-8a83-4b8c-8499-46992761eafe] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:50.599216 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9df09c43-66f2-4938-89ba-0e3298e3f821 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:50.599674 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9df09c43-66f2-4938-89ba-0e3298e3f821 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:50.600520 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9df09c43-66f2-4938-89ba-0e3298e3f821 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:50.600922 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-9df09c43-66f2-4938-89ba-0e3298e3f821 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:50.615241 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.wsgi [None req-9df09c43-66f2-4938-89ba-0e3298e3f821 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] HTTP exception thrown: Instance 2e42b781-8a83-4b8c-8499-46992761eafe could not be found. Jun 25 16:15:50.616856 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-9df09c43-66f2-4938-89ba-0e3298e3f821 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Request method failure captured: Jun 25 16:15:50.616856 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: request: DELETE /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe HTTP/1.1 Jun 25 16:15:50.616856 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept: application/json Jun 25 16:15:50.616856 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept-Encoding: identity Jun 25 16:15:50.616856 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Connection: close Jun 25 16:15:50.616856 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Length: 0 Jun 25 16:15:50.616856 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Type: application/json Jun 25 16:15:50.616856 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Host: 10.222.0.13 Jun 25 16:15:50.616856 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Openstack-System-Scope: None Jun 25 16:15:50.616856 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: User-Agent: python-urllib3/1.26.9 Jun 25 16:15:50.616856 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Auth-Token: gAAAAABitzO-OK9jhEcDWyxqOa8K-5Le5kJKq_SsM4XXokc7VVmoPPd-42rHpgqLb-hZ2UQvDe9jcgPLvsz3UPtKOnJuq8JVcsXwBOgCF4l9qa3QXae1V1RlJSU2e3mJLgHcfBWdkdqzMQRNBtqwcGpODk_8Vj3wdrBfuly72pvE_y1gMlL8jlA Jun 25 16:15:50.616856 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Id: None Jun 25 16:15:50.616856 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Name: None Jun 25 16:15:50.616856 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Identity-Status: Confirmed Jun 25 16:15:50.616856 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Is-Admin-Project: True Jun 25 16:15:50.616856 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Id: default Jun 25 16:15:50.616856 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Name: Default Jun 25 16:15:50.616856 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Id: 93ca9301bea041ce881109c706904a0a Jun 25 16:15:50.616856 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Name: tempest-AttachVolumeTestJSON-1792173987 Jun 25 16:15:50.616856 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Role: reader,member Jun 25 16:15:50.616856 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Roles: reader,member Jun 25 16:15:50.628696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/93ca9301bea041ce881109c706904a0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/93ca9301bea041ce881109c706904a0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_93ca9301bea041ce881109c706904a0a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/93ca9301bea041ce881109c706904a0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:15:50.628696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant: tempest-AttachVolumeTestJSON-1792173987 Jun 25 16:15:50.628696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Id: 93ca9301bea041ce881109c706904a0a Jun 25 16:15:50.628696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1792173987 Jun 25 16:15:50.628696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User: tempest-AttachVolumeTestJSON-1792173987-project Jun 25 16:15:50.628696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Id: default Jun 25 16:15:50.628696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Name: Default Jun 25 16:15:50.628696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Id: 5c2141524dc546259cd993ace59e33f3 Jun 25 16:15:50.628696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Name: tempest-AttachVolumeTestJSON-1792173987-project Jun 25 16:15:50.628696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: method: > Jun 25 16:15:50.628696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: exception: Instance 2e42b781-8a83-4b8c-8499-46992761eafe could not be found. Jun 25 16:15:50.628696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: action_args: {'id': '2e42b781-8a83-4b8c-8499-46992761eafe'} Jun 25 16:15:50.629594 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:15:50.629594 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:50.629594 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:15:50.629594 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:15:50.629594 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:15:50.629594 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:15:50.629594 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:15:50.629594 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:15:50.629594 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:15:50.629594 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:15:50.629594 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e42b781-8a83-4b8c-8499-46992761eafe could not be found. Jun 25 16:15:50.629594 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:50.629594 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:15:50.629594 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:50.629594 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:50.629594 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:15:50.629594 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:15:50.629594 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:15:50.629594 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:15:50.629594 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:15:50.631128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:15:50.631128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 16:15:50.631128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 16:15:50.631128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 16:15:50.631128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 16:15:50.631128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:15:50.631128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:15:50.631128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:15:50.631128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:15:50.631128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e42b781-8a83-4b8c-8499-46992761eafe could not be found. Jun 25 16:15:50.631128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:50.631128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:15:50.631128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:50.631128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:50.631128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:15:50.631128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:15:50.631128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:15:50.631128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:15:50.631128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e42b781-8a83-4b8c-8499-46992761eafe could not be found. Jun 25 16:15:50.631128 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:50.632854 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-9df09c43-66f2-4938-89ba-0e3298e3f821 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Returning 404 to user: Instance 2e42b781-8a83-4b8c-8499-46992761eafe could not be found. {{(pid=117794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:15:50.632854 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-9df09c43-66f2-4938-89ba-0e3298e3f821 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe" status: 404 len: 111 microversion: 2.1 time: 0.031259 Jun 25 16:15:50.632854 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 440/885] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Jun 25 16:15:50 2022] DELETE /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:15:50.633138 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7337669f-2219-4d81-88eb-22a632348126 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:50.633138 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7337669f-2219-4d81-88eb-22a632348126 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: 2e42b781-8a83-4b8c-8499-46992761eafe] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:50.645129 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7337669f-2219-4d81-88eb-22a632348126 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:50.645583 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7337669f-2219-4d81-88eb-22a632348126 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:50.646683 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7337669f-2219-4d81-88eb-22a632348126 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:50.647280 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7337669f-2219-4d81-88eb-22a632348126 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:50.663602 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-7337669f-2219-4d81-88eb-22a632348126 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] HTTP exception thrown: Instance 2e42b781-8a83-4b8c-8499-46992761eafe could not be found. Jun 25 16:15:50.665604 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7337669f-2219-4d81-88eb-22a632348126 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Request method failure captured: Jun 25 16:15:50.665604 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe HTTP/1.1 Jun 25 16:15:50.665604 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept: application/json Jun 25 16:15:50.665604 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jun 25 16:15:50.665604 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Connection: close Jun 25 16:15:50.665604 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jun 25 16:15:50.665604 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jun 25 16:15:50.665604 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Host: 10.222.0.13 Jun 25 16:15:50.665604 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jun 25 16:15:50.665604 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jun 25 16:15:50.665604 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABitzO-OK9jhEcDWyxqOa8K-5Le5kJKq_SsM4XXokc7VVmoPPd-42rHpgqLb-hZ2UQvDe9jcgPLvsz3UPtKOnJuq8JVcsXwBOgCF4l9qa3QXae1V1RlJSU2e3mJLgHcfBWdkdqzMQRNBtqwcGpODk_8Vj3wdrBfuly72pvE_y1gMlL8jlA Jun 25 16:15:50.665604 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jun 25 16:15:50.665604 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jun 25 16:15:50.665604 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jun 25 16:15:50.665604 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jun 25 16:15:50.665604 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jun 25 16:15:50.665604 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jun 25 16:15:50.665604 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Id: 93ca9301bea041ce881109c706904a0a Jun 25 16:15:50.665604 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeTestJSON-1792173987 Jun 25 16:15:50.665604 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Role: reader,member Jun 25 16:15:50.665604 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Jun 25 16:15:50.667970 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/93ca9301bea041ce881109c706904a0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/93ca9301bea041ce881109c706904a0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_93ca9301bea041ce881109c706904a0a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/93ca9301bea041ce881109c706904a0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:15:50.667970 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeTestJSON-1792173987 Jun 25 16:15:50.667970 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 93ca9301bea041ce881109c706904a0a Jun 25 16:15:50.667970 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1792173987 Jun 25 16:15:50.667970 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeTestJSON-1792173987-project Jun 25 16:15:50.667970 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jun 25 16:15:50.667970 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jun 25 16:15:50.667970 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Id: 5c2141524dc546259cd993ace59e33f3 Jun 25 16:15:50.667970 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeTestJSON-1792173987-project Jun 25 16:15:50.667970 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: method: > Jun 25 16:15:50.667970 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: exception: Instance 2e42b781-8a83-4b8c-8499-46992761eafe could not be found. Jun 25 16:15:50.667970 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: action_args: {'id': '2e42b781-8a83-4b8c-8499-46992761eafe'} Jun 25 16:15:50.668850 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:15:50.668850 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:50.668850 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:15:50.668850 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:15:50.668850 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:15:50.668850 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:15:50.668850 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:15:50.668850 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:15:50.668850 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:15:50.668850 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:15:50.668850 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e42b781-8a83-4b8c-8499-46992761eafe could not be found. Jun 25 16:15:50.668850 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:50.668850 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:15:50.668850 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:50.668850 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:50.668850 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:15:50.668850 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:15:50.668850 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:15:50.668850 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:15:50.668850 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:15:50.670217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:15:50.670217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 16:15:50.670217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 16:15:50.670217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:15:50.670217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:15:50.670217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:15:50.670217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:15:50.670217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e42b781-8a83-4b8c-8499-46992761eafe could not be found. Jun 25 16:15:50.670217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:50.670217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:15:50.670217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:50.670217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:50.670217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:15:50.670217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:15:50.670217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:15:50.670217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:15:50.670217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e42b781-8a83-4b8c-8499-46992761eafe could not be found. Jun 25 16:15:50.670217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:50.671596 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7337669f-2219-4d81-88eb-22a632348126 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Returning 404 to user: Instance 2e42b781-8a83-4b8c-8499-46992761eafe could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:15:50.671596 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7337669f-2219-4d81-88eb-22a632348126 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe" status: 404 len: 111 microversion: 2.1 time: 0.040975 Jun 25 16:15:50.671596 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 446/886] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:15:50 2022] GET /compute/v2.1/servers/2e42b781-8a83-4b8c-8499-46992761eafe => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:15:51.827808 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-2748ee10-7e2a-48a5-9cb3-dcbe0735d34f tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:51.828364 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-2748ee10-7e2a-48a5-9cb3-dcbe0735d34f tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:51.835282 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2748ee10-7e2a-48a5-9cb3-dcbe0735d34f tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:51.835739 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2748ee10-7e2a-48a5-9cb3-dcbe0735d34f tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:51.836532 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2748ee10-7e2a-48a5-9cb3-dcbe0735d34f tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:51.836985 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2748ee10-7e2a-48a5-9cb3-dcbe0735d34f tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:51.851486 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.wsgi [None req-2748ee10-7e2a-48a5-9cb3-dcbe0735d34f tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] HTTP exception thrown: Instance d0460a39-cea4-4afc-92b3-091c5a768695 could not be found. Jun 25 16:15:51.853553 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-2748ee10-7e2a-48a5-9cb3-dcbe0735d34f tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Request method failure captured: Jun 25 16:15:51.853553 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: request: DELETE /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 HTTP/1.1 Jun 25 16:15:51.853553 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept: application/json Jun 25 16:15:51.853553 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept-Encoding: identity Jun 25 16:15:51.853553 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Connection: close Jun 25 16:15:51.853553 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Length: 0 Jun 25 16:15:51.853553 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Type: application/json Jun 25 16:15:51.853553 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Host: 10.222.0.13 Jun 25 16:15:51.853553 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Openstack-System-Scope: None Jun 25 16:15:51.853553 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: User-Agent: python-urllib3/1.26.9 Jun 25 16:15:51.853553 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Auth-Token: gAAAAABitzO-OK9jhEcDWyxqOa8K-5Le5kJKq_SsM4XXokc7VVmoPPd-42rHpgqLb-hZ2UQvDe9jcgPLvsz3UPtKOnJuq8JVcsXwBOgCF4l9qa3QXae1V1RlJSU2e3mJLgHcfBWdkdqzMQRNBtqwcGpODk_8Vj3wdrBfuly72pvE_y1gMlL8jlA Jun 25 16:15:51.853553 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Id: None Jun 25 16:15:51.853553 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Name: None Jun 25 16:15:51.853553 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Identity-Status: Confirmed Jun 25 16:15:51.853553 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Is-Admin-Project: True Jun 25 16:15:51.853553 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Id: default Jun 25 16:15:51.853553 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Name: Default Jun 25 16:15:51.853553 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Id: 93ca9301bea041ce881109c706904a0a Jun 25 16:15:51.853553 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Name: tempest-AttachVolumeTestJSON-1792173987 Jun 25 16:15:51.853553 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Role: reader,member Jun 25 16:15:51.853553 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Roles: reader,member Jun 25 16:15:51.855309 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/93ca9301bea041ce881109c706904a0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/93ca9301bea041ce881109c706904a0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_93ca9301bea041ce881109c706904a0a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/93ca9301bea041ce881109c706904a0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:15:51.855309 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant: tempest-AttachVolumeTestJSON-1792173987 Jun 25 16:15:51.855309 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Id: 93ca9301bea041ce881109c706904a0a Jun 25 16:15:51.855309 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1792173987 Jun 25 16:15:51.855309 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User: tempest-AttachVolumeTestJSON-1792173987-project Jun 25 16:15:51.855309 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Id: default Jun 25 16:15:51.855309 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Name: Default Jun 25 16:15:51.855309 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Id: 5c2141524dc546259cd993ace59e33f3 Jun 25 16:15:51.855309 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Name: tempest-AttachVolumeTestJSON-1792173987-project Jun 25 16:15:51.855309 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: method: > Jun 25 16:15:51.855309 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: exception: Instance d0460a39-cea4-4afc-92b3-091c5a768695 could not be found. Jun 25 16:15:51.855309 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: action_args: {'id': 'd0460a39-cea4-4afc-92b3-091c5a768695'} Jun 25 16:15:51.859280 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:15:51.859280 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:51.859280 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:15:51.859280 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:15:51.859280 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:15:51.859280 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:15:51.859280 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:15:51.859280 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:15:51.859280 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:15:51.859280 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:15:51.859280 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0460a39-cea4-4afc-92b3-091c5a768695 could not be found. Jun 25 16:15:51.859280 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:51.859280 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:15:51.859280 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:51.859280 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:51.859280 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:15:51.859280 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:15:51.859280 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:15:51.859280 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:15:51.859280 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:15:51.860875 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:15:51.860875 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 16:15:51.860875 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 16:15:51.860875 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 16:15:51.860875 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 16:15:51.860875 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:15:51.860875 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:15:51.860875 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:15:51.860875 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:15:51.860875 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0460a39-cea4-4afc-92b3-091c5a768695 could not be found. Jun 25 16:15:51.860875 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:51.860875 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:15:51.860875 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:51.860875 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:51.860875 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:15:51.860875 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:15:51.860875 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:15:51.860875 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:15:51.860875 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0460a39-cea4-4afc-92b3-091c5a768695 could not be found. Jun 25 16:15:51.860875 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:51.862650 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-2748ee10-7e2a-48a5-9cb3-dcbe0735d34f tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Returning 404 to user: Instance d0460a39-cea4-4afc-92b3-091c5a768695 could not be found. {{(pid=117794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:15:51.862650 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-2748ee10-7e2a-48a5-9cb3-dcbe0735d34f tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 404 len: 111 microversion: 2.1 time: 0.031096 Jun 25 16:15:51.862650 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 441/887] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Jun 25 16:15:51 2022] DELETE /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:15:51.866324 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-be936c3e-5c70-429a-a3d2-691fec0ae825 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:51.867062 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-be936c3e-5c70-429a-a3d2-691fec0ae825 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] [instance: d0460a39-cea4-4afc-92b3-091c5a768695] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:51.877642 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be936c3e-5c70-429a-a3d2-691fec0ae825 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:51.878179 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be936c3e-5c70-429a-a3d2-691fec0ae825 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:51.879329 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be936c3e-5c70-429a-a3d2-691fec0ae825 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:51.879938 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-be936c3e-5c70-429a-a3d2-691fec0ae825 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:51.895221 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-be936c3e-5c70-429a-a3d2-691fec0ae825 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] HTTP exception thrown: Instance d0460a39-cea4-4afc-92b3-091c5a768695 could not be found. Jun 25 16:15:51.896810 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-be936c3e-5c70-429a-a3d2-691fec0ae825 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Request method failure captured: Jun 25 16:15:51.896810 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 HTTP/1.1 Jun 25 16:15:51.896810 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept: application/json Jun 25 16:15:51.896810 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jun 25 16:15:51.896810 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Connection: close Jun 25 16:15:51.896810 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jun 25 16:15:51.896810 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jun 25 16:15:51.896810 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Host: 10.222.0.13 Jun 25 16:15:51.896810 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jun 25 16:15:51.896810 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jun 25 16:15:51.896810 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABitzO-OK9jhEcDWyxqOa8K-5Le5kJKq_SsM4XXokc7VVmoPPd-42rHpgqLb-hZ2UQvDe9jcgPLvsz3UPtKOnJuq8JVcsXwBOgCF4l9qa3QXae1V1RlJSU2e3mJLgHcfBWdkdqzMQRNBtqwcGpODk_8Vj3wdrBfuly72pvE_y1gMlL8jlA Jun 25 16:15:51.896810 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jun 25 16:15:51.896810 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jun 25 16:15:51.896810 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jun 25 16:15:51.896810 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jun 25 16:15:51.896810 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jun 25 16:15:51.896810 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jun 25 16:15:51.896810 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Id: 93ca9301bea041ce881109c706904a0a Jun 25 16:15:51.896810 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-AttachVolumeTestJSON-1792173987 Jun 25 16:15:51.896810 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Role: reader,member Jun 25 16:15:51.896810 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Jun 25 16:15:51.898992 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/93ca9301bea041ce881109c706904a0a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/93ca9301bea041ce881109c706904a0a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_93ca9301bea041ce881109c706904a0a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/93ca9301bea041ce881109c706904a0a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:15:51.898992 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-AttachVolumeTestJSON-1792173987 Jun 25 16:15:51.898992 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 93ca9301bea041ce881109c706904a0a Jun 25 16:15:51.898992 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1792173987 Jun 25 16:15:51.898992 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User: tempest-AttachVolumeTestJSON-1792173987-project Jun 25 16:15:51.898992 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jun 25 16:15:51.898992 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jun 25 16:15:51.898992 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Id: 5c2141524dc546259cd993ace59e33f3 Jun 25 16:15:51.898992 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-AttachVolumeTestJSON-1792173987-project Jun 25 16:15:51.898992 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: method: > Jun 25 16:15:51.898992 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: exception: Instance d0460a39-cea4-4afc-92b3-091c5a768695 could not be found. Jun 25 16:15:51.898992 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: action_args: {'id': 'd0460a39-cea4-4afc-92b3-091c5a768695'} Jun 25 16:15:51.900498 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:15:51.900498 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:51.900498 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:15:51.900498 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:15:51.900498 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:15:51.900498 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:15:51.900498 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:15:51.900498 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:15:51.900498 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:15:51.900498 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:15:51.900498 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0460a39-cea4-4afc-92b3-091c5a768695 could not be found. Jun 25 16:15:51.900498 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:51.900498 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:15:51.900498 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:51.900498 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:51.900498 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:15:51.900498 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:15:51.900498 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:15:51.900498 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:15:51.900498 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:15:51.902032 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:15:51.902032 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 16:15:51.902032 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 16:15:51.902032 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:15:51.902032 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:15:51.902032 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:15:51.902032 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:15:51.902032 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0460a39-cea4-4afc-92b3-091c5a768695 could not be found. Jun 25 16:15:51.902032 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:51.902032 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:15:51.902032 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:51.902032 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:51.902032 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:15:51.902032 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:15:51.902032 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:15:51.902032 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:15:51.902032 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0460a39-cea4-4afc-92b3-091c5a768695 could not be found. Jun 25 16:15:51.902032 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:51.903417 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-be936c3e-5c70-429a-a3d2-691fec0ae825 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] Returning 404 to user: Instance d0460a39-cea4-4afc-92b3-091c5a768695 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:15:51.903417 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-be936c3e-5c70-429a-a3d2-691fec0ae825 tempest-AttachVolumeTestJSON-1792173987 tempest-AttachVolumeTestJSON-1792173987-project] 10.222.0.13 "GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695" status: 404 len: 111 microversion: 2.1 time: 0.037487 Jun 25 16:15:51.903417 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 447/888] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:15:51 2022] GET /compute/v2.1/servers/d0460a39-cea4-4afc-92b3-091c5a768695 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:15:55.236167 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-28a7aa17-4a8d-4b1f-8408-46a363011d5f tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:55.236769 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-28a7aa17-4a8d-4b1f-8408-46a363011d5f tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 3193adb5-3665-405c-b68c-30023d88105d] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:55.239242 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_api:SELECT=23 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:15:55.244648 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-28a7aa17-4a8d-4b1f-8408-46a363011d5f tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:55.245101 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-28a7aa17-4a8d-4b1f-8408-46a363011d5f tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:55.245880 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-28a7aa17-4a8d-4b1f-8408-46a363011d5f tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:55.246320 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-28a7aa17-4a8d-4b1f-8408-46a363011d5f tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:55.249610 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:15:55.278922 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-28a7aa17-4a8d-4b1f-8408-46a363011d5f tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 3193adb5-3665-405c-b68c-30023d88105d] Going to try to terminate instance {{(pid=117794) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 16:15:55.359263 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-28a7aa17-4a8d-4b1f-8408-46a363011d5f tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d" status: 204 len: 0 microversion: 2.1 time: 0.126784 Jun 25 16:15:55.359984 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 442/889] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Jun 25 16:15:55 2022] DELETE /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 16:15:55.370052 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-da27ec2b-a872-48cc-b8c2-35e96e1a6180 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:55.370858 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-da27ec2b-a872-48cc-b8c2-35e96e1a6180 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 3193adb5-3665-405c-b68c-30023d88105d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:55.373457 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:15:55.379579 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-da27ec2b-a872-48cc-b8c2-35e96e1a6180 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:55.380024 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-da27ec2b-a872-48cc-b8c2-35e96e1a6180 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:55.380913 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-da27ec2b-a872-48cc-b8c2-35e96e1a6180 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:55.381351 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-da27ec2b-a872-48cc-b8c2-35e96e1a6180 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:55.384721 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:15:55.521714 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-da27ec2b-a872-48cc-b8c2-35e96e1a6180 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:15:55.529374 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-da27ec2b-a872-48cc-b8c2-35e96e1a6180 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d" status: 200 len: 1577 microversion: 2.1 time: 0.164800 Jun 25 16:15:55.529937 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 448/890] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:15:55 2022] GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:15:56.143948 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-c54ef2f5-9494-4be1-a415-3efd612deb72 tempest-VolumesNegativeTest-1677723279 tempest-VolumesNegativeTest-1677723279-project] Action: 'create', calling method: .version_select at 0x7f65bb5691f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1080531021", "metadata": {"Type": "work"}}} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:15:56.161944 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-c54ef2f5-9494-4be1-a415-3efd612deb72 tempest-VolumesNegativeTest-1677723279 tempest-VolumesNegativeTest-1677723279-project] Request method failure captured: Jun 25 16:15:56.161944 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 25 16:15:56.161944 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept: application/json Jun 25 16:15:56.161944 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept-Encoding: identity Jun 25 16:15:56.161944 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Connection: close Jun 25 16:15:56.161944 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Length: 122 Jun 25 16:15:56.161944 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Type: application/json Jun 25 16:15:56.161944 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Host: 10.222.0.13 Jun 25 16:15:56.161944 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Openstack-System-Scope: None Jun 25 16:15:56.161944 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: User-Agent: python-urllib3/1.26.9 Jun 25 16:15:56.161944 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Auth-Token: gAAAAABitzS7p3-zvYMunhtgsNGNb8n0ue-phJ7jzEI2dLr4sti38o1fwNiMcKUUK-0ynaCLEb-XjwBLUsMfbGdfFt6_kB-cd0QFFkWsYXXD194q_njAPnzTMa8l1ZH3RxbFw-isEdCfxszoSJlhwD8f_prx582N2nG5ev47YSGjltTmOEuojTY Jun 25 16:15:56.161944 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Id: None Jun 25 16:15:56.161944 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Name: None Jun 25 16:15:56.161944 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Identity-Status: Confirmed Jun 25 16:15:56.161944 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Is-Admin-Project: True Jun 25 16:15:56.161944 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Id: default Jun 25 16:15:56.161944 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Name: Default Jun 25 16:15:56.161944 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Id: 734020a939754d21a86482a3d013cb6d Jun 25 16:15:56.161944 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Name: tempest-VolumesNegativeTest-1677723279 Jun 25 16:15:56.161944 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Role: reader,member Jun 25 16:15:56.161944 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Roles: reader,member Jun 25 16:15:56.163528 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/734020a939754d21a86482a3d013cb6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/734020a939754d21a86482a3d013cb6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_734020a939754d21a86482a3d013cb6d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/734020a939754d21a86482a3d013cb6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:15:56.163528 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant: tempest-VolumesNegativeTest-1677723279 Jun 25 16:15:56.163528 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Id: 734020a939754d21a86482a3d013cb6d Jun 25 16:15:56.163528 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Name: tempest-VolumesNegativeTest-1677723279 Jun 25 16:15:56.163528 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User: tempest-VolumesNegativeTest-1677723279-project Jun 25 16:15:56.163528 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Id: default Jun 25 16:15:56.163528 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Name: Default Jun 25 16:15:56.163528 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Id: a1d4468465144f4cad71a8f5bfd3d697 Jun 25 16:15:56.163528 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Name: tempest-VolumesNegativeTest-1677723279-project Jun 25 16:15:56.163528 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Jun 25 16:15:56.163528 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1080531021", "metadata": {"Type": "work"}}} Jun 25 16:15:56.163528 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: method: Jun 25 16:15:56.163528 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 25 16:15:56.164734 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1080531021', 'metadata': {'Type': 'work'}}}} Jun 25 16:15:56.164734 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:15:56.164734 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:56.164734 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 16:15:56.164734 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 16:15:56.164734 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 16:15:56.164734 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise error Jun 25 16:15:56.164734 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 25 16:15:56.164734 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.164734 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 25 16:15:56.164734 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 25 16:15:56.164734 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.164734 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 25 16:15:56.164734 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi '#$%' Jun 25 16:15:56.164734 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.164734 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:15:56.164734 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.164734 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:56.164734 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:15:56.164734 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:15:56.164734 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:15:56.164734 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:15:56.166358 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 16:15:56.166358 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 16:15:56.166358 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:15:56.166358 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:15:56.166358 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 16:15:56.166358 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 16:15:56.166358 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 16:15:56.166358 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 16:15:56.166358 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 16:15:56.166358 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 16:15:56.166358 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 25 16:15:56.166358 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.166358 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:15:56.166358 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.166358 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:56.166358 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:15:56.166358 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:15:56.166358 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 16:15:56.166358 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 16:15:56.167662 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 25 16:15:56.167662 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.167662 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-c54ef2f5-9494-4be1-a415-3efd612deb72 tempest-VolumesNegativeTest-1677723279 tempest-VolumesNegativeTest-1677723279-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:15:56.167662 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-c54ef2f5-9494-4be1-a415-3efd612deb72 tempest-VolumesNegativeTest-1677723279 tempest-VolumesNegativeTest-1677723279-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.146288 Jun 25 16:15:56.169120 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 443/891] 10.222.0.13 () {60 vars in 1155 bytes} [Sat Jun 25 16:15:56 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 16:15:56.174541 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4d3dca98-664f-492f-a803-84d8ec00026a tempest-VolumesNegativeTest-1677723279 tempest-VolumesNegativeTest-1677723279-project] Action: 'create', calling method: .version_select at 0x7f65bb592160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1280262406", "metadata": {"Type": "work"}}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:15:56.177811 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4d3dca98-664f-492f-a803-84d8ec00026a tempest-VolumesNegativeTest-1677723279 tempest-VolumesNegativeTest-1677723279-project] Request method failure captured: Jun 25 16:15:56.177811 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 25 16:15:56.177811 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept: application/json Jun 25 16:15:56.177811 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jun 25 16:15:56.177811 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Connection: close Jun 25 16:15:56.177811 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Length: 120 Jun 25 16:15:56.177811 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jun 25 16:15:56.177811 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Host: 10.222.0.13 Jun 25 16:15:56.177811 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jun 25 16:15:56.177811 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jun 25 16:15:56.177811 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABitzS7p3-zvYMunhtgsNGNb8n0ue-phJ7jzEI2dLr4sti38o1fwNiMcKUUK-0ynaCLEb-XjwBLUsMfbGdfFt6_kB-cd0QFFkWsYXXD194q_njAPnzTMa8l1ZH3RxbFw-isEdCfxszoSJlhwD8f_prx582N2nG5ev47YSGjltTmOEuojTY Jun 25 16:15:56.177811 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jun 25 16:15:56.177811 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jun 25 16:15:56.177811 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jun 25 16:15:56.177811 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jun 25 16:15:56.177811 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jun 25 16:15:56.177811 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jun 25 16:15:56.177811 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Id: 734020a939754d21a86482a3d013cb6d Jun 25 16:15:56.177811 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-VolumesNegativeTest-1677723279 Jun 25 16:15:56.177811 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Role: reader,member Jun 25 16:15:56.177811 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Jun 25 16:15:56.179348 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/734020a939754d21a86482a3d013cb6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/734020a939754d21a86482a3d013cb6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_734020a939754d21a86482a3d013cb6d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/734020a939754d21a86482a3d013cb6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:15:56.179348 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-VolumesNegativeTest-1677723279 Jun 25 16:15:56.179348 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 734020a939754d21a86482a3d013cb6d Jun 25 16:15:56.179348 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-VolumesNegativeTest-1677723279 Jun 25 16:15:56.179348 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User: tempest-VolumesNegativeTest-1677723279-project Jun 25 16:15:56.179348 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jun 25 16:15:56.179348 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jun 25 16:15:56.179348 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Id: a1d4468465144f4cad71a8f5bfd3d697 Jun 25 16:15:56.179348 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-VolumesNegativeTest-1677723279-project Jun 25 16:15:56.179348 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Jun 25 16:15:56.179348 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1280262406", "metadata": {"Type": "work"}}} Jun 25 16:15:56.179348 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: method: Jun 25 16:15:56.179348 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 25 16:15:56.180830 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1280262406', 'metadata': {'Type': 'work'}}}} Jun 25 16:15:56.180830 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:15:56.180830 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:56.180830 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 16:15:56.180830 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 16:15:56.180830 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 16:15:56.180830 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise error Jun 25 16:15:56.180830 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 25 16:15:56.180830 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.180830 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 25 16:15:56.180830 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 25 16:15:56.180830 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.180830 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 25 16:15:56.180830 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi '0' Jun 25 16:15:56.180830 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.180830 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:15:56.180830 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.180830 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:56.180830 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:15:56.180830 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:15:56.180830 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:15:56.180830 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:15:56.186186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 16:15:56.186186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 16:15:56.186186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:15:56.186186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:15:56.186186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 16:15:56.186186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 16:15:56.186186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 16:15:56.186186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 16:15:56.186186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 16:15:56.186186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 16:15:56.186186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 25 16:15:56.186186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.186186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:15:56.186186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.186186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:56.186186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:15:56.186186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:15:56.186186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 16:15:56.186186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 16:15:56.187629 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 25 16:15:56.187629 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.187629 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4d3dca98-664f-492f-a803-84d8ec00026a tempest-VolumesNegativeTest-1677723279 tempest-VolumesNegativeTest-1677723279-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:15:56.187629 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4d3dca98-664f-492f-a803-84d8ec00026a tempest-VolumesNegativeTest-1677723279 tempest-VolumesNegativeTest-1677723279-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008882 Jun 25 16:15:56.187629 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 449/892] 10.222.0.13 () {60 vars in 1155 bytes} [Sat Jun 25 16:15:56 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 16:15:56.188946 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-36db529b-131e-4f39-8658-995cdf7cc9ae tempest-VolumesNegativeTest-1677723279 tempest-VolumesNegativeTest-1677723279-project] Action: 'create', calling method: .version_select at 0x7f65bb517790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1901380743", "metadata": {"Type": "work"}}} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:15:56.192075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-36db529b-131e-4f39-8658-995cdf7cc9ae tempest-VolumesNegativeTest-1677723279 tempest-VolumesNegativeTest-1677723279-project] Request method failure captured: Jun 25 16:15:56.192075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 25 16:15:56.192075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept: application/json Jun 25 16:15:56.192075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept-Encoding: identity Jun 25 16:15:56.192075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Connection: close Jun 25 16:15:56.192075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Length: 119 Jun 25 16:15:56.192075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Type: application/json Jun 25 16:15:56.192075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Host: 10.222.0.13 Jun 25 16:15:56.192075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Openstack-System-Scope: None Jun 25 16:15:56.192075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: User-Agent: python-urllib3/1.26.9 Jun 25 16:15:56.192075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Auth-Token: gAAAAABitzS7p3-zvYMunhtgsNGNb8n0ue-phJ7jzEI2dLr4sti38o1fwNiMcKUUK-0ynaCLEb-XjwBLUsMfbGdfFt6_kB-cd0QFFkWsYXXD194q_njAPnzTMa8l1ZH3RxbFw-isEdCfxszoSJlhwD8f_prx582N2nG5ev47YSGjltTmOEuojTY Jun 25 16:15:56.192075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Id: None Jun 25 16:15:56.192075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Name: None Jun 25 16:15:56.192075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Identity-Status: Confirmed Jun 25 16:15:56.192075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Is-Admin-Project: True Jun 25 16:15:56.192075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Id: default Jun 25 16:15:56.192075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Name: Default Jun 25 16:15:56.192075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Id: 734020a939754d21a86482a3d013cb6d Jun 25 16:15:56.192075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Name: tempest-VolumesNegativeTest-1677723279 Jun 25 16:15:56.192075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Role: reader,member Jun 25 16:15:56.192075 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Roles: reader,member Jun 25 16:15:56.193789 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/734020a939754d21a86482a3d013cb6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/734020a939754d21a86482a3d013cb6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_734020a939754d21a86482a3d013cb6d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/734020a939754d21a86482a3d013cb6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:15:56.193789 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant: tempest-VolumesNegativeTest-1677723279 Jun 25 16:15:56.193789 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Id: 734020a939754d21a86482a3d013cb6d Jun 25 16:15:56.193789 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Name: tempest-VolumesNegativeTest-1677723279 Jun 25 16:15:56.193789 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User: tempest-VolumesNegativeTest-1677723279-project Jun 25 16:15:56.193789 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Id: default Jun 25 16:15:56.193789 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Name: Default Jun 25 16:15:56.193789 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Id: a1d4468465144f4cad71a8f5bfd3d697 Jun 25 16:15:56.193789 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Name: tempest-VolumesNegativeTest-1677723279-project Jun 25 16:15:56.193789 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Jun 25 16:15:56.193789 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1901380743", "metadata": {"Type": "work"}}} Jun 25 16:15:56.193789 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: method: Jun 25 16:15:56.193789 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 25 16:15:56.195145 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1901380743', 'metadata': {'Type': 'work'}}}} Jun 25 16:15:56.195145 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:15:56.195145 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:56.195145 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 25 16:15:56.195145 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 25 16:15:56.195145 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 25 16:15:56.195145 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise error Jun 25 16:15:56.195145 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 25 16:15:56.195145 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.195145 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 25 16:15:56.195145 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 25 16:15:56.195145 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.195145 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 25 16:15:56.195145 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi '' Jun 25 16:15:56.195145 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.195145 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:15:56.195145 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.195145 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:56.195145 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:15:56.195145 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:15:56.195145 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:15:56.195145 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:15:56.197002 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 16:15:56.197002 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 16:15:56.197002 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:15:56.197002 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:15:56.197002 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 25 16:15:56.197002 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 25 16:15:56.197002 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 25 16:15:56.197002 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 25 16:15:56.197002 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 25 16:15:56.197002 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 25 16:15:56.197002 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 25 16:15:56.197002 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.197002 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:15:56.197002 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.197002 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:56.197002 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:15:56.197002 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:15:56.197002 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 25 16:15:56.197002 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 25 16:15:56.198187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 25 16:15:56.198187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.198187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-36db529b-131e-4f39-8658-995cdf7cc9ae tempest-VolumesNegativeTest-1677723279 tempest-VolumesNegativeTest-1677723279-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:15:56.198187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-36db529b-131e-4f39-8658-995cdf7cc9ae tempest-VolumesNegativeTest-1677723279 tempest-VolumesNegativeTest-1677723279-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008719 Jun 25 16:15:56.198187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 444/893] 10.222.0.13 () {60 vars in 1155 bytes} [Sat Jun 25 16:15:56 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 25 16:15:56.209026 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-44de18ab-c7b6-4a3d-9032-a9ce8680e054 tempest-VolumesNegativeTest-1677723279 tempest-VolumesNegativeTest-1677723279-project] Calling method '.version_select at 0x7f65bb53d1f0>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:56.238376 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-44de18ab-c7b6-4a3d-9032-a9ce8680e054 tempest-VolumesNegativeTest-1677723279 tempest-VolumesNegativeTest-1677723279-project] HTTP exception thrown: Volume tempest-invalid-891200043 could not be found. Jun 25 16:15:56.242449 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-44de18ab-c7b6-4a3d-9032-a9ce8680e054 tempest-VolumesNegativeTest-1677723279 tempest-VolumesNegativeTest-1677723279-project] Request method failure captured: Jun 25 16:15:56.242449 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-891200043 HTTP/1.1 Jun 25 16:15:56.242449 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept: application/json Jun 25 16:15:56.242449 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jun 25 16:15:56.242449 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Connection: close Jun 25 16:15:56.242449 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jun 25 16:15:56.242449 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jun 25 16:15:56.242449 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Host: 10.222.0.13 Jun 25 16:15:56.242449 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jun 25 16:15:56.242449 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jun 25 16:15:56.242449 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABitzS7p3-zvYMunhtgsNGNb8n0ue-phJ7jzEI2dLr4sti38o1fwNiMcKUUK-0ynaCLEb-XjwBLUsMfbGdfFt6_kB-cd0QFFkWsYXXD194q_njAPnzTMa8l1ZH3RxbFw-isEdCfxszoSJlhwD8f_prx582N2nG5ev47YSGjltTmOEuojTY Jun 25 16:15:56.242449 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jun 25 16:15:56.242449 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jun 25 16:15:56.242449 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jun 25 16:15:56.242449 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jun 25 16:15:56.242449 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jun 25 16:15:56.242449 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jun 25 16:15:56.242449 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Id: 734020a939754d21a86482a3d013cb6d Jun 25 16:15:56.242449 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-VolumesNegativeTest-1677723279 Jun 25 16:15:56.242449 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Role: reader,member Jun 25 16:15:56.242449 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Jun 25 16:15:56.244115 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/734020a939754d21a86482a3d013cb6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/734020a939754d21a86482a3d013cb6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_734020a939754d21a86482a3d013cb6d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/734020a939754d21a86482a3d013cb6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:15:56.244115 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-VolumesNegativeTest-1677723279 Jun 25 16:15:56.244115 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 734020a939754d21a86482a3d013cb6d Jun 25 16:15:56.244115 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-VolumesNegativeTest-1677723279 Jun 25 16:15:56.244115 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User: tempest-VolumesNegativeTest-1677723279-project Jun 25 16:15:56.244115 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jun 25 16:15:56.244115 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jun 25 16:15:56.244115 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Id: a1d4468465144f4cad71a8f5bfd3d697 Jun 25 16:15:56.244115 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-VolumesNegativeTest-1677723279-project Jun 25 16:15:56.244115 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: method: Jun 25 16:15:56.244115 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: exception: Volume tempest-invalid-891200043 could not be found. Jun 25 16:15:56.244115 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: action_args: {'id': 'tempest-invalid-891200043'} Jun 25 16:15:56.244115 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:15:56.245196 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:56.245196 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 25 16:15:56.245196 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 25 16:15:56.245196 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 25 16:15:56.245196 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 25 16:15:56.245196 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 25 16:15:56.245196 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 25 16:15:56.245196 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 25 16:15:56.245196 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 25 16:15:56.245196 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 25 16:15:56.245196 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 25 16:15:56.245196 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 16:15:56.245196 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 16:15:56.245196 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 16:15:56.245196 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 16:15:56.245196 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-891200043 could not be found. (HTTP 404) (Request-ID: req-e4e3ad9d-cbe2-4b9d-aa68-0cc7cd1aa4bf) Jun 25 16:15:56.245196 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.245196 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:15:56.245196 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.247008 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:56.247008 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 25 16:15:56.247008 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 25 16:15:56.247008 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 25 16:15:56.247008 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 25 16:15:56.247008 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 25 16:15:56.247008 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 25 16:15:56.247008 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 25 16:15:56.247008 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 25 16:15:56.247008 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 25 16:15:56.247008 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 25 16:15:56.247008 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 25 16:15:56.247008 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 25 16:15:56.247008 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 25 16:15:56.247008 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 25 16:15:56.247008 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 25 16:15:56.247008 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 25 16:15:56.247008 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 25 16:15:56.247008 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 25 16:15:56.248378 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 16:15:56.248378 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 16:15:56.248378 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 16:15:56.248378 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 16:15:56.248378 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-891200043 could not be found. Jun 25 16:15:56.248378 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.248378 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:15:56.248378 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.248378 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:56.248378 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:15:56.248378 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:15:56.248378 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:15:56.248378 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:15:56.248378 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 16:15:56.248378 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 16:15:56.248378 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:15:56.248378 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:15:56.248378 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 25 16:15:56.248378 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:15:56.248378 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-891200043 could not be found. Jun 25 16:15:56.249924 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.249924 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:15:56.249924 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.249924 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:56.249924 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:15:56.249924 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:15:56.249924 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:15:56.249924 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:15:56.249924 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-891200043 could not be found. Jun 25 16:15:56.249924 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.249924 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-44de18ab-c7b6-4a3d-9032-a9ce8680e054 tempest-VolumesNegativeTest-1677723279 tempest-VolumesNegativeTest-1677723279-project] Returning 404 to user: Volume tempest-invalid-891200043 could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:15:56.249924 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-44de18ab-c7b6-4a3d-9032-a9ce8680e054 tempest-VolumesNegativeTest-1677723279 tempest-VolumesNegativeTest-1677723279-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/tempest-invalid-891200043" status: 404 len: 98 microversion: 2.1 time: 0.038844 Jun 25 16:15:56.249924 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 450/894] 10.222.0.13 () {58 vars in 1214 bytes} [Sat Jun 25 16:15:56 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-891200043 => generated 98 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 25 16:15:56.255912 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-7f15812f-4dc1-4a5f-a858-b56f3c5b4c55 tempest-VolumesNegativeTest-1677723279 tempest-VolumesNegativeTest-1677723279-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004477 Jun 25 16:15:56.259988 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 445/895] 10.222.0.13 () {58 vars in 1139 bytes} [Sat Jun 25 16:15:56 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 25 16:15:56.265527 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6f08e3cf-f4a5-40a4-ada7-a2ddf36fbf89 tempest-VolumesNegativeTest-1677723279 tempest-VolumesNegativeTest-1677723279-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004159 Jun 25 16:15:56.266017 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 451/896] 10.222.0.13 () {58 vars in 1136 bytes} [Sat Jun 25 16:15:56 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 25 16:15:56.275271 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-5c5030a0-73ed-4ded-a4d4-be59f580ec4e tempest-VolumesNegativeTest-1677723279 tempest-VolumesNegativeTest-1677723279-project] Calling method '.version_select at 0x7f65bb550310>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:56.304278 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.wsgi [None req-5c5030a0-73ed-4ded-a4d4-be59f580ec4e tempest-VolumesNegativeTest-1677723279 tempest-VolumesNegativeTest-1677723279-project] HTTP exception thrown: Volume ab596e06-fe7b-4cea-adb4-cfe665fc4205 could not be found. Jun 25 16:15:56.306311 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-5c5030a0-73ed-4ded-a4d4-be59f580ec4e tempest-VolumesNegativeTest-1677723279 tempest-VolumesNegativeTest-1677723279-project] Request method failure captured: Jun 25 16:15:56.306311 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: request: DELETE /compute/v2.1/os-volumes/ab596e06-fe7b-4cea-adb4-cfe665fc4205 HTTP/1.1 Jun 25 16:15:56.306311 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept: application/json Jun 25 16:15:56.306311 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept-Encoding: identity Jun 25 16:15:56.306311 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Connection: close Jun 25 16:15:56.306311 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Length: 0 Jun 25 16:15:56.306311 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Type: application/json Jun 25 16:15:56.306311 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Host: 10.222.0.13 Jun 25 16:15:56.306311 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Openstack-System-Scope: None Jun 25 16:15:56.306311 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: User-Agent: python-urllib3/1.26.9 Jun 25 16:15:56.306311 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Auth-Token: gAAAAABitzS7p3-zvYMunhtgsNGNb8n0ue-phJ7jzEI2dLr4sti38o1fwNiMcKUUK-0ynaCLEb-XjwBLUsMfbGdfFt6_kB-cd0QFFkWsYXXD194q_njAPnzTMa8l1ZH3RxbFw-isEdCfxszoSJlhwD8f_prx582N2nG5ev47YSGjltTmOEuojTY Jun 25 16:15:56.306311 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Id: None Jun 25 16:15:56.306311 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Name: None Jun 25 16:15:56.306311 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Identity-Status: Confirmed Jun 25 16:15:56.306311 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Is-Admin-Project: True Jun 25 16:15:56.306311 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Id: default Jun 25 16:15:56.306311 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Name: Default Jun 25 16:15:56.306311 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Id: 734020a939754d21a86482a3d013cb6d Jun 25 16:15:56.306311 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Name: tempest-VolumesNegativeTest-1677723279 Jun 25 16:15:56.306311 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Role: reader,member Jun 25 16:15:56.306311 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Roles: reader,member Jun 25 16:15:56.307871 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/734020a939754d21a86482a3d013cb6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/734020a939754d21a86482a3d013cb6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_734020a939754d21a86482a3d013cb6d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/734020a939754d21a86482a3d013cb6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:15:56.307871 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant: tempest-VolumesNegativeTest-1677723279 Jun 25 16:15:56.307871 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Id: 734020a939754d21a86482a3d013cb6d Jun 25 16:15:56.307871 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Name: tempest-VolumesNegativeTest-1677723279 Jun 25 16:15:56.307871 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User: tempest-VolumesNegativeTest-1677723279-project Jun 25 16:15:56.307871 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Id: default Jun 25 16:15:56.307871 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Name: Default Jun 25 16:15:56.307871 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Id: a1d4468465144f4cad71a8f5bfd3d697 Jun 25 16:15:56.307871 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Name: tempest-VolumesNegativeTest-1677723279-project Jun 25 16:15:56.307871 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: method: Jun 25 16:15:56.307871 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: exception: Volume ab596e06-fe7b-4cea-adb4-cfe665fc4205 could not be found. Jun 25 16:15:56.307871 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: action_args: {'id': 'ab596e06-fe7b-4cea-adb4-cfe665fc4205'} Jun 25 16:15:56.307871 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:15:56.308878 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:56.308878 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 25 16:15:56.308878 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 25 16:15:56.308878 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 25 16:15:56.308878 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 25 16:15:56.308878 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 25 16:15:56.308878 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 25 16:15:56.308878 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 25 16:15:56.308878 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 25 16:15:56.308878 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 25 16:15:56.308878 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 25 16:15:56.308878 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 16:15:56.308878 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 16:15:56.308878 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 16:15:56.308878 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 16:15:56.308878 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ab596e06-fe7b-4cea-adb4-cfe665fc4205 could not be found. (HTTP 404) (Request-ID: req-fdabbd44-65c5-4743-8a92-e7f7e0afe7ae) Jun 25 16:15:56.308878 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.308878 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:15:56.308878 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.310267 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:56.310267 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 25 16:15:56.310267 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 25 16:15:56.310267 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 25 16:15:56.310267 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 25 16:15:56.310267 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 25 16:15:56.310267 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 25 16:15:56.310267 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 25 16:15:56.310267 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 25 16:15:56.310267 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 25 16:15:56.310267 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 25 16:15:56.310267 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 25 16:15:56.310267 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 25 16:15:56.310267 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 25 16:15:56.310267 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 25 16:15:56.310267 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 25 16:15:56.310267 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 25 16:15:56.310267 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 25 16:15:56.310267 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 25 16:15:56.311461 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 16:15:56.311461 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 16:15:56.311461 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 16:15:56.311461 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 16:15:56.311461 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ab596e06-fe7b-4cea-adb4-cfe665fc4205 could not be found. Jun 25 16:15:56.311461 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.311461 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:15:56.311461 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.311461 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:56.311461 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:15:56.311461 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:15:56.311461 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:15:56.311461 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:15:56.311461 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 16:15:56.311461 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 16:15:56.311461 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:15:56.311461 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:15:56.311461 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 25 16:15:56.311461 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:15:56.313129 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ab596e06-fe7b-4cea-adb4-cfe665fc4205 could not be found. Jun 25 16:15:56.313129 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.313129 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:15:56.313129 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.313129 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:56.313129 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:15:56.313129 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:15:56.313129 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:15:56.313129 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:15:56.313129 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ab596e06-fe7b-4cea-adb4-cfe665fc4205 could not be found. Jun 25 16:15:56.313129 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.313129 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-5c5030a0-73ed-4ded-a4d4-be59f580ec4e tempest-VolumesNegativeTest-1677723279 tempest-VolumesNegativeTest-1677723279-project] Returning 404 to user: Volume ab596e06-fe7b-4cea-adb4-cfe665fc4205 could not be found. {{(pid=117794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:15:56.313129 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-5c5030a0-73ed-4ded-a4d4-be59f580ec4e tempest-VolumesNegativeTest-1677723279 tempest-VolumesNegativeTest-1677723279-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/ab596e06-fe7b-4cea-adb4-cfe665fc4205" status: 404 len: 109 microversion: 2.1 time: 0.036700 Jun 25 16:15:56.313129 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 446/897] 10.222.0.13 () {58 vars in 1247 bytes} [Sat Jun 25 16:15:56 2022] DELETE /compute/v2.1/os-volumes/ab596e06-fe7b-4cea-adb4-cfe665fc4205 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:15:56.317444 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-075e8315-3946-4e0b-a303-d4a63eb0d26a tempest-VolumesNegativeTest-1677723279 tempest-VolumesNegativeTest-1677723279-project] Calling method '.version_select at 0x7f65bb53d280>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:56.344961 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-075e8315-3946-4e0b-a303-d4a63eb0d26a tempest-VolumesNegativeTest-1677723279 tempest-VolumesNegativeTest-1677723279-project] HTTP exception thrown: Volume 9ac8203d-dcaa-43bf-bd89-e4605287a0cf could not be found. Jun 25 16:15:56.346916 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-075e8315-3946-4e0b-a303-d4a63eb0d26a tempest-VolumesNegativeTest-1677723279 tempest-VolumesNegativeTest-1677723279-project] Request method failure captured: Jun 25 16:15:56.346916 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/os-volumes/9ac8203d-dcaa-43bf-bd89-e4605287a0cf HTTP/1.1 Jun 25 16:15:56.346916 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept: application/json Jun 25 16:15:56.346916 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jun 25 16:15:56.346916 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Connection: close Jun 25 16:15:56.346916 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jun 25 16:15:56.346916 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jun 25 16:15:56.346916 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Host: 10.222.0.13 Jun 25 16:15:56.346916 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jun 25 16:15:56.346916 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jun 25 16:15:56.346916 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABitzS7p3-zvYMunhtgsNGNb8n0ue-phJ7jzEI2dLr4sti38o1fwNiMcKUUK-0ynaCLEb-XjwBLUsMfbGdfFt6_kB-cd0QFFkWsYXXD194q_njAPnzTMa8l1ZH3RxbFw-isEdCfxszoSJlhwD8f_prx582N2nG5ev47YSGjltTmOEuojTY Jun 25 16:15:56.346916 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jun 25 16:15:56.346916 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jun 25 16:15:56.346916 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jun 25 16:15:56.346916 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jun 25 16:15:56.346916 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jun 25 16:15:56.346916 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jun 25 16:15:56.346916 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Id: 734020a939754d21a86482a3d013cb6d Jun 25 16:15:56.346916 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-VolumesNegativeTest-1677723279 Jun 25 16:15:56.346916 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Role: reader,member Jun 25 16:15:56.346916 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Jun 25 16:15:56.348546 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/734020a939754d21a86482a3d013cb6d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/734020a939754d21a86482a3d013cb6d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_734020a939754d21a86482a3d013cb6d", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/734020a939754d21a86482a3d013cb6d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:15:56.348546 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-VolumesNegativeTest-1677723279 Jun 25 16:15:56.348546 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Id: 734020a939754d21a86482a3d013cb6d Jun 25 16:15:56.348546 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-VolumesNegativeTest-1677723279 Jun 25 16:15:56.348546 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User: tempest-VolumesNegativeTest-1677723279-project Jun 25 16:15:56.348546 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jun 25 16:15:56.348546 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jun 25 16:15:56.348546 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Id: a1d4468465144f4cad71a8f5bfd3d697 Jun 25 16:15:56.348546 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-VolumesNegativeTest-1677723279-project Jun 25 16:15:56.348546 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: method: Jun 25 16:15:56.348546 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: exception: Volume 9ac8203d-dcaa-43bf-bd89-e4605287a0cf could not be found. Jun 25 16:15:56.348546 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: action_args: {'id': '9ac8203d-dcaa-43bf-bd89-e4605287a0cf'} Jun 25 16:15:56.348546 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:15:56.349525 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:56.349525 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 25 16:15:56.349525 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 25 16:15:56.349525 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 25 16:15:56.349525 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 25 16:15:56.349525 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 25 16:15:56.349525 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 25 16:15:56.349525 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 25 16:15:56.349525 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 25 16:15:56.349525 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 25 16:15:56.349525 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 25 16:15:56.349525 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 16:15:56.349525 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 16:15:56.349525 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 16:15:56.349525 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 16:15:56.349525 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9ac8203d-dcaa-43bf-bd89-e4605287a0cf could not be found. (HTTP 404) (Request-ID: req-09a4d54b-4e36-4360-9d2f-da3a32669c0e) Jun 25 16:15:56.349525 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.349525 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:15:56.349525 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.350981 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:56.350981 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 25 16:15:56.350981 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 25 16:15:56.350981 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 25 16:15:56.350981 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 25 16:15:56.350981 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 25 16:15:56.350981 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 25 16:15:56.350981 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 25 16:15:56.350981 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 25 16:15:56.350981 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 25 16:15:56.350981 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 25 16:15:56.350981 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 25 16:15:56.350981 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 25 16:15:56.350981 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 25 16:15:56.350981 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 25 16:15:56.350981 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 25 16:15:56.350981 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 25 16:15:56.350981 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 25 16:15:56.350981 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 25 16:15:56.352361 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 25 16:15:56.352361 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 25 16:15:56.352361 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 25 16:15:56.352361 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 25 16:15:56.352361 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9ac8203d-dcaa-43bf-bd89-e4605287a0cf could not be found. Jun 25 16:15:56.352361 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.352361 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:15:56.352361 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.352361 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:56.352361 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:15:56.352361 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:15:56.352361 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:15:56.352361 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:15:56.352361 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 25 16:15:56.352361 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 25 16:15:56.352361 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:15:56.352361 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:15:56.352361 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 25 16:15:56.352361 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:15:56.354186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9ac8203d-dcaa-43bf-bd89-e4605287a0cf could not be found. Jun 25 16:15:56.354186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.354186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:15:56.354186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.354186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:56.354186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:15:56.354186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:15:56.354186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:15:56.354186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:15:56.354186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9ac8203d-dcaa-43bf-bd89-e4605287a0cf could not be found. Jun 25 16:15:56.354186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:56.354186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-075e8315-3946-4e0b-a303-d4a63eb0d26a tempest-VolumesNegativeTest-1677723279 tempest-VolumesNegativeTest-1677723279-project] Returning 404 to user: Volume 9ac8203d-dcaa-43bf-bd89-e4605287a0cf could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:15:56.354186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-075e8315-3946-4e0b-a303-d4a63eb0d26a tempest-VolumesNegativeTest-1677723279 tempest-VolumesNegativeTest-1677723279-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/9ac8203d-dcaa-43bf-bd89-e4605287a0cf" status: 404 len: 109 microversion: 2.1 time: 0.034531 Jun 25 16:15:56.354186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 452/898] 10.222.0.13 () {58 vars in 1244 bytes} [Sat Jun 25 16:15:56 2022] GET /compute/v2.1/os-volumes/9ac8203d-dcaa-43bf-bd89-e4605287a0cf => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:15:56.546917 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-cd36c683-abec-4952-b459-56a718c4395b tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:56.548375 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-cd36c683-abec-4952-b459-56a718c4395b tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 3193adb5-3665-405c-b68c-30023d88105d] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:56.554505 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cd36c683-abec-4952-b459-56a718c4395b tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:56.554996 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cd36c683-abec-4952-b459-56a718c4395b tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:56.555868 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cd36c683-abec-4952-b459-56a718c4395b tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:56.556435 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cd36c683-abec-4952-b459-56a718c4395b tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:56.693607 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-cd36c683-abec-4952-b459-56a718c4395b tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:15:56.703593 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-cd36c683-abec-4952-b459-56a718c4395b tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d" status: 200 len: 1577 microversion: 2.1 time: 0.160452 Jun 25 16:15:56.704067 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 447/899] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:15:56 2022] GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:15:57.637179 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-a37e8366-f945-4f94-987c-2f42a1ea0ca2 req-f91d2367-434d-42d2-8aea-a669410abfe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3193adb5-3665-405c-b68c-30023d88105d", "name": "network-vif-deleted", "tag": "1a9f7280-53f6-4175-893c-f00a3bb1d1d4"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:15:57.648285 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-a37e8366-f945-4f94-987c-2f42a1ea0ca2 req-f91d2367-434d-42d2-8aea-a669410abfe6 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:57.648758 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-a37e8366-f945-4f94-987c-2f42a1ea0ca2 req-f91d2367-434d-42d2-8aea-a669410abfe6 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:57.660306 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-a37e8366-f945-4f94-987c-2f42a1ea0ca2 req-f91d2367-434d-42d2-8aea-a669410abfe6 service nova] Creating event network-vif-deleted:1a9f7280-53f6-4175-893c-f00a3bb1d1d4 for instance 3193adb5-3665-405c-b68c-30023d88105d on hv-cinder-84762 Jun 25 16:15:57.667475 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-a37e8366-f945-4f94-987c-2f42a1ea0ca2 req-f91d2367-434d-42d2-8aea-a669410abfe6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034691 Jun 25 16:15:57.669244 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 453/900] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:15:57.724035 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-a8bbbab7-10ac-4c55-a0b9-1915ed7b7b9f tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:57.724515 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-a8bbbab7-10ac-4c55-a0b9-1915ed7b7b9f tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 3193adb5-3665-405c-b68c-30023d88105d] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:57.733702 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a8bbbab7-10ac-4c55-a0b9-1915ed7b7b9f tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:57.734201 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a8bbbab7-10ac-4c55-a0b9-1915ed7b7b9f tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:57.735605 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a8bbbab7-10ac-4c55-a0b9-1915ed7b7b9f tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:57.736473 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a8bbbab7-10ac-4c55-a0b9-1915ed7b7b9f tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:57.812482 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-a8bbbab7-10ac-4c55-a0b9-1915ed7b7b9f tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:15:57.832383 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-a8bbbab7-10ac-4c55-a0b9-1915ed7b7b9f tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d" status: 200 len: 1224 microversion: 2.1 time: 0.114613 Jun 25 16:15:57.837213 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 448/901] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:15:57 2022] GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d => generated 1224 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:15:58.851300 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-28781757-7fbb-4a29-bf98-976fe431d438 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:58.852004 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-28781757-7fbb-4a29-bf98-976fe431d438 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 3193adb5-3665-405c-b68c-30023d88105d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:58.858543 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-28781757-7fbb-4a29-bf98-976fe431d438 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:58.862227 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-28781757-7fbb-4a29-bf98-976fe431d438 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:58.862981 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-28781757-7fbb-4a29-bf98-976fe431d438 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:58.863575 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-28781757-7fbb-4a29-bf98-976fe431d438 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:58.879240 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-28781757-7fbb-4a29-bf98-976fe431d438 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] HTTP exception thrown: Instance 3193adb5-3665-405c-b68c-30023d88105d could not be found. Jun 25 16:15:58.880964 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-28781757-7fbb-4a29-bf98-976fe431d438 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Request method failure captured: Jun 25 16:15:58.880964 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d HTTP/1.1 Jun 25 16:15:58.880964 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept: application/json Jun 25 16:15:58.880964 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jun 25 16:15:58.880964 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Connection: close Jun 25 16:15:58.880964 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jun 25 16:15:58.880964 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jun 25 16:15:58.880964 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Host: 10.222.0.13 Jun 25 16:15:58.880964 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jun 25 16:15:58.880964 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jun 25 16:15:58.880964 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABitzQb-xw95mjecey84BRjb_sUuTti5eEkBXvXkQMog8OEulHRzkQ55Yt_C-J3nkeMNJZWKrD6E7TkI2e1wqtLNkmM1pQxFbwGdu_pPimUhn1tuo1_zNrTPVSUQxqUL9j2ZrMXyaoX2LbVyOCGwF8jj877nxLXfggjnLUjUGa6alxlsdk Jun 25 16:15:58.880964 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jun 25 16:15:58.880964 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jun 25 16:15:58.880964 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jun 25 16:15:58.880964 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jun 25 16:15:58.880964 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jun 25 16:15:58.880964 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jun 25 16:15:58.880964 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Id: c5bb30b042f3422faf43af82b27b37a5 Jun 25 16:15:58.880964 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-TestVolumeBootPattern-647003375 Jun 25 16:15:58.880964 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Role: reader,member Jun 25 16:15:58.880964 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Jun 25 16:15:58.882328 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c5bb30b042f3422faf43af82b27b37a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c5bb30b042f3422faf43af82b27b37a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c5bb30b042f3422faf43af82b27b37a5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c5bb30b042f3422faf43af82b27b37a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:15:58.882328 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-TestVolumeBootPattern-647003375 Jun 25 16:15:58.882328 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Id: c5bb30b042f3422faf43af82b27b37a5 Jun 25 16:15:58.882328 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-TestVolumeBootPattern-647003375 Jun 25 16:15:58.882328 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User: tempest-TestVolumeBootPattern-647003375-project Jun 25 16:15:58.882328 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jun 25 16:15:58.882328 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jun 25 16:15:58.882328 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Id: 0ef599055aed42f3a97fb30bba553fb0 Jun 25 16:15:58.882328 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-TestVolumeBootPattern-647003375-project Jun 25 16:15:58.882328 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: method: > Jun 25 16:15:58.882328 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: exception: Instance 3193adb5-3665-405c-b68c-30023d88105d could not be found. Jun 25 16:15:58.882328 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: action_args: {'id': '3193adb5-3665-405c-b68c-30023d88105d'} Jun 25 16:15:58.883097 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:15:58.883097 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:58.883097 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:15:58.883097 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:15:58.883097 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:15:58.883097 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:15:58.883097 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:15:58.883097 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:15:58.883097 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:15:58.883097 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:15:58.883097 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3193adb5-3665-405c-b68c-30023d88105d could not be found. Jun 25 16:15:58.883097 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:58.883097 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:15:58.883097 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:58.883097 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:58.883097 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:15:58.883097 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:15:58.883097 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:15:58.883097 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:15:58.883097 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:15:58.884647 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:15:58.884647 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 16:15:58.884647 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 16:15:58.884647 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:15:58.884647 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:15:58.884647 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:15:58.884647 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:15:58.884647 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3193adb5-3665-405c-b68c-30023d88105d could not be found. Jun 25 16:15:58.884647 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:58.884647 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:15:58.884647 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:58.884647 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:15:58.884647 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:15:58.884647 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:15:58.884647 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:15:58.884647 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:15:58.884647 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3193adb5-3665-405c-b68c-30023d88105d could not be found. Jun 25 16:15:58.884647 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:15:58.886708 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-28781757-7fbb-4a29-bf98-976fe431d438 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Returning 404 to user: Instance 3193adb5-3665-405c-b68c-30023d88105d could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:15:58.887768 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-28781757-7fbb-4a29-bf98-976fe431d438 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d" status: 404 len: 111 microversion: 2.1 time: 0.042026 Jun 25 16:15:58.888579 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 454/902] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:15:58 2022] GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:15:58.991208 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-bc8a17e1-1b27-48ff-a85d-fef1f0c247f9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-297536661", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-38770479", "security_groups": [{"name": "tempest-secgroup-smoke-1054987293"}], "block_device_mapping_v2": [{"uuid": "e03c5494-1f63-4d89-8927-77d35f2d6b5d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4493f90c-02cf-4ced-9f9f-700abb5cb837"}]}} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:15:59.116260 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.network.neutron [None req-bc8a17e1-1b27-48ff-a85d-fef1f0c247f9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] validate_networks() for [('4493f90c-02cf-4ced-9f9f-700abb5cb837', None, None, None, None, None)] {{(pid=117794) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 16:15:59.520677 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-bc8a17e1-1b27-48ff-a85d-fef1f0c247f9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Flavor limits 0:0:0 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 16:15:59.521117 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-bc8a17e1-1b27-48ff-a85d-fef1f0c247f9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Image limits 0:0:0 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 16:15:59.521595 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-bc8a17e1-1b27-48ff-a85d-fef1f0c247f9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Flavor pref 0:0:0 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 16:15:59.522008 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-bc8a17e1-1b27-48ff-a85d-fef1f0c247f9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Image pref 0:0:0 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 16:15:59.522453 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.virt.hardware [None req-bc8a17e1-1b27-48ff-a85d-fef1f0c247f9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117794) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 16:15:59.532227 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-bc8a17e1-1b27-48ff-a85d-fef1f0c247f9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:59.532710 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-bc8a17e1-1b27-48ff-a85d-fef1f0c247f9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:59.533562 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-bc8a17e1-1b27-48ff-a85d-fef1f0c247f9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:15:59.534028 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-bc8a17e1-1b27-48ff-a85d-fef1f0c247f9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:15:59.551756 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.quota [None req-bc8a17e1-1b27-48ff-a85d-fef1f0c247f9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Getting quotas for project c5bb30b042f3422faf43af82b27b37a5. Resources: {'ram', 'cores', 'instances'} {{(pid=117794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:15:59.556474 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.quota [None req-bc8a17e1-1b27-48ff-a85d-fef1f0c247f9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Getting quotas for user 0ef599055aed42f3a97fb30bba553fb0 and project c5bb30b042f3422faf43af82b27b37a5. Resources: {'ram', 'cores', 'instances'} {{(pid=117794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:15:59.621538 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-bc8a17e1-1b27-48ff-a85d-fef1f0c247f9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Going to run 1 instances... {{(pid=117794) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 16:15:59.624880 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-bc8a17e1-1b27-48ff-a85d-fef1f0c247f9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 268b2363-bee8-4f04-a236-5b2a92fdd9d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e03c5494-1f63-4d89-8927-77d35f2d6b5d',volume_size=None,volume_type=None)] {{(pid=117794) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 16:15:59.776377 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-bc8a17e1-1b27-48ff-a85d-fef1f0c247f9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.789079 Jun 25 16:15:59.777144 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 449/903] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Jun 25 16:15:58 2022] POST /compute/v2.1/servers => generated 406 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 16:15:59.787131 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b350c574-7965-4ba4-9ac1-023187dc1c38 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:15:59.787735 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b350c574-7965-4ba4-9ac1-023187dc1c38 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 268b2363-bee8-4f04-a236-5b2a92fdd9d2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:15:59.841793 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-b350c574-7965-4ba4-9ac1-023187dc1c38 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:15:59.850210 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b350c574-7965-4ba4-9ac1-023187dc1c38 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2" status: 200 len: 1092 microversion: 2.1 time: 0.066937 Jun 25 16:15:59.851260 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 455/904] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:15:59 2022] GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2 => generated 1092 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:16:00.867845 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-e9c0fe8b-1870-4a83-90e0-713cb04d61b3 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:16:00.868656 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-e9c0fe8b-1870-4a83-90e0-713cb04d61b3 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 268b2363-bee8-4f04-a236-5b2a92fdd9d2] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:16:00.878088 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e9c0fe8b-1870-4a83-90e0-713cb04d61b3 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:00.878694 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e9c0fe8b-1870-4a83-90e0-713cb04d61b3 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:00.879700 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e9c0fe8b-1870-4a83-90e0-713cb04d61b3 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:00.880772 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e9c0fe8b-1870-4a83-90e0-713cb04d61b3 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:00.967221 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-e9c0fe8b-1870-4a83-90e0-713cb04d61b3 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:16:00.974853 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-e9c0fe8b-1870-4a83-90e0-713cb04d61b3 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2" status: 200 len: 1208 microversion: 2.1 time: 0.110981 Jun 25 16:16:00.975596 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 450/905] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:16:00 2022] GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2 => generated 1208 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:16:01.992866 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6e813fe9-b12d-442d-b3ac-f5fa92dd2422 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:16:01.996716 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6e813fe9-b12d-442d-b3ac-f5fa92dd2422 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 268b2363-bee8-4f04-a236-5b2a92fdd9d2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:16:02.010186 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6e813fe9-b12d-442d-b3ac-f5fa92dd2422 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:02.010950 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6e813fe9-b12d-442d-b3ac-f5fa92dd2422 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:02.012053 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6e813fe9-b12d-442d-b3ac-f5fa92dd2422 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:02.012715 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6e813fe9-b12d-442d-b3ac-f5fa92dd2422 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:02.296833 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6e813fe9-b12d-442d-b3ac-f5fa92dd2422 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:16:02.304780 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6e813fe9-b12d-442d-b3ac-f5fa92dd2422 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2" status: 200 len: 1264 microversion: 2.1 time: 0.315919 Jun 25 16:16:02.314719 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 456/906] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:16:01 2022] GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2 => generated 1264 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:16:02.611061 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-69a170c6-02c9-4ab6-a52f-bf70cff6575c req-68923147-d33a-450c-bcd3-81c8422cbbe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "268b2363-bee8-4f04-a236-5b2a92fdd9d2", "tag": "0c4c3de8-0099-4bf6-aba3-58227e338f77"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:16:02.629079 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-69a170c6-02c9-4ab6-a52f-bf70cff6575c req-68923147-d33a-450c-bcd3-81c8422cbbe3 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:02.629889 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-69a170c6-02c9-4ab6-a52f-bf70cff6575c req-68923147-d33a-450c-bcd3-81c8422cbbe3 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:02.656084 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-69a170c6-02c9-4ab6-a52f-bf70cff6575c req-68923147-d33a-450c-bcd3-81c8422cbbe3 service nova] Creating event network-changed:0c4c3de8-0099-4bf6-aba3-58227e338f77 for instance 268b2363-bee8-4f04-a236-5b2a92fdd9d2 on hv-cinder-84762 Jun 25 16:16:02.663334 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-69a170c6-02c9-4ab6-a52f-bf70cff6575c req-68923147-d33a-450c-bcd3-81c8422cbbe3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056660 Jun 25 16:16:02.665443 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 451/907] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:16:03.321980 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-225232ec-f94f-4181-8ba0-4735537e7ba9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:16:03.322588 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-225232ec-f94f-4181-8ba0-4735537e7ba9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 268b2363-bee8-4f04-a236-5b2a92fdd9d2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:16:03.328742 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-225232ec-f94f-4181-8ba0-4735537e7ba9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:03.329225 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-225232ec-f94f-4181-8ba0-4735537e7ba9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:03.329990 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-225232ec-f94f-4181-8ba0-4735537e7ba9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:03.330386 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-225232ec-f94f-4181-8ba0-4735537e7ba9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:03.812727 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-225232ec-f94f-4181-8ba0-4735537e7ba9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:16:03.821491 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-225232ec-f94f-4181-8ba0-4735537e7ba9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2" status: 200 len: 1264 microversion: 2.1 time: 0.503788 Jun 25 16:16:03.822324 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 457/908] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:16:03 2022] GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2 => generated 1264 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:16:04.840206 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-23acc488-bd24-4a94-9ecc-7f37a1e64904 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:16:04.840962 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-23acc488-bd24-4a94-9ecc-7f37a1e64904 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 268b2363-bee8-4f04-a236-5b2a92fdd9d2] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:16:04.848535 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-23acc488-bd24-4a94-9ecc-7f37a1e64904 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:04.849591 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-23acc488-bd24-4a94-9ecc-7f37a1e64904 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:04.850855 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-23acc488-bd24-4a94-9ecc-7f37a1e64904 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:04.851590 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-23acc488-bd24-4a94-9ecc-7f37a1e64904 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:04.991675 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-23acc488-bd24-4a94-9ecc-7f37a1e64904 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:16:04.999878 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-23acc488-bd24-4a94-9ecc-7f37a1e64904 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2" status: 200 len: 1264 microversion: 2.1 time: 0.164588 Jun 25 16:16:05.000469 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 452/909] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:16:04 2022] GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:16:06.019842 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-cf423eed-2957-4b27-8755-bcfcec8f66ce tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:16:06.020820 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-cf423eed-2957-4b27-8755-bcfcec8f66ce tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 268b2363-bee8-4f04-a236-5b2a92fdd9d2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:16:06.031424 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cf423eed-2957-4b27-8755-bcfcec8f66ce tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:06.032142 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cf423eed-2957-4b27-8755-bcfcec8f66ce tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:06.033471 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cf423eed-2957-4b27-8755-bcfcec8f66ce tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:06.034283 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cf423eed-2957-4b27-8755-bcfcec8f66ce tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:06.186536 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-cf423eed-2957-4b27-8755-bcfcec8f66ce tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:16:06.194365 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-cf423eed-2957-4b27-8755-bcfcec8f66ce tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2" status: 200 len: 1264 microversion: 2.1 time: 0.181084 Jun 25 16:16:06.195071 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 458/910] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:16:06 2022] GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:16:07.211679 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-b02aa806-e449-4a76-a122-c6c2239f19d2 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:16:07.212452 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-b02aa806-e449-4a76-a122-c6c2239f19d2 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 268b2363-bee8-4f04-a236-5b2a92fdd9d2] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:16:07.219621 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b02aa806-e449-4a76-a122-c6c2239f19d2 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:07.220080 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b02aa806-e449-4a76-a122-c6c2239f19d2 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:07.220986 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b02aa806-e449-4a76-a122-c6c2239f19d2 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:07.221424 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b02aa806-e449-4a76-a122-c6c2239f19d2 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:07.367630 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-b02aa806-e449-4a76-a122-c6c2239f19d2 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:16:07.375586 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-b02aa806-e449-4a76-a122-c6c2239f19d2 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2" status: 200 len: 1264 microversion: 2.1 time: 0.167971 Jun 25 16:16:07.376147 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 453/911] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:16:07 2022] GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:16:08.396993 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-d78c01be-25be-4b09-a650-7ee5ff1c0f23 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:16:08.397817 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-d78c01be-25be-4b09-a650-7ee5ff1c0f23 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 268b2363-bee8-4f04-a236-5b2a92fdd9d2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:16:08.408984 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d78c01be-25be-4b09-a650-7ee5ff1c0f23 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:08.409728 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d78c01be-25be-4b09-a650-7ee5ff1c0f23 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:08.410966 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d78c01be-25be-4b09-a650-7ee5ff1c0f23 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:08.411677 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-d78c01be-25be-4b09-a650-7ee5ff1c0f23 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:08.549023 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-d78c01be-25be-4b09-a650-7ee5ff1c0f23 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:16:08.557074 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-d78c01be-25be-4b09-a650-7ee5ff1c0f23 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2" status: 200 len: 1264 microversion: 2.1 time: 0.166701 Jun 25 16:16:08.557647 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 459/912] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:16:08 2022] GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2 => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:16:09.578395 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-c035b3d5-a14f-4967-bd58-ef0fd296cf7c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:16:09.579117 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-c035b3d5-a14f-4967-bd58-ef0fd296cf7c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 268b2363-bee8-4f04-a236-5b2a92fdd9d2] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:16:09.581640 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell0:SELECT=2 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:16:09.582357 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell0:SELECT=6 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:16:09.588764 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-c035b3d5-a14f-4967-bd58-ef0fd296cf7c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:09.589217 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-c035b3d5-a14f-4967-bd58-ef0fd296cf7c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:09.589980 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-c035b3d5-a14f-4967-bd58-ef0fd296cf7c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:09.590412 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-c035b3d5-a14f-4967-bd58-ef0fd296cf7c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:09.866772 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-c035b3d5-a14f-4967-bd58-ef0fd296cf7c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:16:09.874563 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-c035b3d5-a14f-4967-bd58-ef0fd296cf7c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2" status: 200 len: 1264 microversion: 2.1 time: 0.300188 Jun 25 16:16:09.875116 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 454/913] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:16:09 2022] GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2 => generated 1264 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:16:10.891474 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-cdac41c0-d84c-4c29-a18a-57662c14e65a tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:16:10.892084 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-cdac41c0-d84c-4c29-a18a-57662c14e65a tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 268b2363-bee8-4f04-a236-5b2a92fdd9d2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:16:10.894543 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:16:10.900191 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cdac41c0-d84c-4c29-a18a-57662c14e65a tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:10.900957 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cdac41c0-d84c-4c29-a18a-57662c14e65a tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:10.901723 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cdac41c0-d84c-4c29-a18a-57662c14e65a tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:10.902151 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-cdac41c0-d84c-4c29-a18a-57662c14e65a tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:11.071291 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-cdac41c0-d84c-4c29-a18a-57662c14e65a tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:16:11.080442 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-cdac41c0-d84c-4c29-a18a-57662c14e65a tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2" status: 200 len: 1264 microversion: 2.1 time: 0.193115 Jun 25 16:16:11.081558 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 460/914] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:16:10 2022] GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2 => generated 1264 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:16:12.097579 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-cf6a6165-4155-4bef-9df3-69279f75dc34 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:16:12.098169 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-cf6a6165-4155-4bef-9df3-69279f75dc34 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 268b2363-bee8-4f04-a236-5b2a92fdd9d2] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:16:12.105360 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cf6a6165-4155-4bef-9df3-69279f75dc34 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:12.105838 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cf6a6165-4155-4bef-9df3-69279f75dc34 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:12.106634 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cf6a6165-4155-4bef-9df3-69279f75dc34 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:12.107070 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cf6a6165-4155-4bef-9df3-69279f75dc34 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:12.242495 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-cf6a6165-4155-4bef-9df3-69279f75dc34 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:16:12.251001 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-cf6a6165-4155-4bef-9df3-69279f75dc34 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2" status: 200 len: 1264 microversion: 2.1 time: 0.157600 Jun 25 16:16:12.251566 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 455/915] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:16:12 2022] GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:16:12.703011 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-449c1d6d-d92f-4d5d-929d-63e9aadf9a2e req-9f8dca90-14dd-4642-834e-eeb4fabd9c15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "268b2363-bee8-4f04-a236-5b2a92fdd9d2", "name": "network-vif-plugged", "status": "completed", "tag": "0c4c3de8-0099-4bf6-aba3-58227e338f77"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:16:12.713152 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-449c1d6d-d92f-4d5d-929d-63e9aadf9a2e req-9f8dca90-14dd-4642-834e-eeb4fabd9c15 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:12.714353 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-449c1d6d-d92f-4d5d-929d-63e9aadf9a2e req-9f8dca90-14dd-4642-834e-eeb4fabd9c15 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:12.727812 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-449c1d6d-d92f-4d5d-929d-63e9aadf9a2e req-9f8dca90-14dd-4642-834e-eeb4fabd9c15 service nova] Creating event network-vif-plugged:0c4c3de8-0099-4bf6-aba3-58227e338f77 for instance 268b2363-bee8-4f04-a236-5b2a92fdd9d2 on hv-cinder-84762 Jun 25 16:16:12.735119 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-449c1d6d-d92f-4d5d-929d-63e9aadf9a2e req-9f8dca90-14dd-4642-834e-eeb4fabd9c15 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035468 Jun 25 16:16:12.735943 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 461/916] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:16:13.268769 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-8e687e1e-d45a-4021-a340-3089b9a18262 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:16:13.269487 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-8e687e1e-d45a-4021-a340-3089b9a18262 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 268b2363-bee8-4f04-a236-5b2a92fdd9d2] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:16:13.276748 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8e687e1e-d45a-4021-a340-3089b9a18262 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:13.277245 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8e687e1e-d45a-4021-a340-3089b9a18262 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:13.278027 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8e687e1e-d45a-4021-a340-3089b9a18262 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:13.278469 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8e687e1e-d45a-4021-a340-3089b9a18262 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:13.413211 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-8e687e1e-d45a-4021-a340-3089b9a18262 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:16:13.421176 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-8e687e1e-d45a-4021-a340-3089b9a18262 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2" status: 200 len: 1264 microversion: 2.1 time: 0.156327 Jun 25 16:16:13.421774 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 456/917] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:16:13 2022] GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:16:14.439396 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-99b425e4-6ef9-4a46-9f2f-f8353fe83038 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:16:14.440346 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-99b425e4-6ef9-4a46-9f2f-f8353fe83038 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 268b2363-bee8-4f04-a236-5b2a92fdd9d2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:16:14.448246 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-99b425e4-6ef9-4a46-9f2f-f8353fe83038 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:14.449016 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-99b425e4-6ef9-4a46-9f2f-f8353fe83038 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:14.449805 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-99b425e4-6ef9-4a46-9f2f-f8353fe83038 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:14.450231 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-99b425e4-6ef9-4a46-9f2f-f8353fe83038 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:14.593805 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-99b425e4-6ef9-4a46-9f2f-f8353fe83038 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:16:14.601521 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-99b425e4-6ef9-4a46-9f2f-f8353fe83038 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2" status: 200 len: 1452 microversion: 2.1 time: 0.166482 Jun 25 16:16:14.602675 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 462/918] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:16:14 2022] GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2 => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:16:14.618242 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-986b0ad7-b669-4eb2-84e6-46a4402210bf tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:16:14.619017 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-986b0ad7-b669-4eb2-84e6-46a4402210bf tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 268b2363-bee8-4f04-a236-5b2a92fdd9d2] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:16:14.625696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-986b0ad7-b669-4eb2-84e6-46a4402210bf tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:14.626146 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-986b0ad7-b669-4eb2-84e6-46a4402210bf tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:14.626960 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-986b0ad7-b669-4eb2-84e6-46a4402210bf tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:14.627398 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-986b0ad7-b669-4eb2-84e6-46a4402210bf tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:14.773095 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-986b0ad7-b669-4eb2-84e6-46a4402210bf tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:16:14.783202 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-986b0ad7-b669-4eb2-84e6-46a4402210bf tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2" status: 200 len: 1452 microversion: 2.1 time: 0.168305 Jun 25 16:16:14.784350 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 457/919] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:16:14 2022] GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2 => generated 1452 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:16:16.237008 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 16:16:16.237566 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Sat Jun 25 16:16:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 16:16:16.439479 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-a5385e97-ec69-4098-b82d-be8bd1e423ee req-aa587257-e172-4337-a7cb-4bfbf9eeb42a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "268b2363-bee8-4f04-a236-5b2a92fdd9d2", "tag": "0c4c3de8-0099-4bf6-aba3-58227e338f77"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:16:16.448678 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-a5385e97-ec69-4098-b82d-be8bd1e423ee req-aa587257-e172-4337-a7cb-4bfbf9eeb42a service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:16.449122 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-a5385e97-ec69-4098-b82d-be8bd1e423ee req-aa587257-e172-4337-a7cb-4bfbf9eeb42a service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:16.459432 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-a5385e97-ec69-4098-b82d-be8bd1e423ee req-aa587257-e172-4337-a7cb-4bfbf9eeb42a service nova] Creating event network-changed:0c4c3de8-0099-4bf6-aba3-58227e338f77 for instance 268b2363-bee8-4f04-a236-5b2a92fdd9d2 on hv-cinder-84762 Jun 25 16:16:16.464331 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-a5385e97-ec69-4098-b82d-be8bd1e423ee req-aa587257-e172-4337-a7cb-4bfbf9eeb42a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028611 Jun 25 16:16:16.464976 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 463/920] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:16:50.475723 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-d25c535c-705d-410b-a233-648db5796a4c tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Action: 'create', calling method: .version_select at 0x7f65bb5504c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1770596430", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrcLd/REe+C31NbzK+QxVSGZ6314plgbvZrLawKXjVYl8BP1X8VxTisHxcpTsmcx+1CdTUJqcQeG1pFUqXv7VBgVUWZugBaf+tv9tvoOAeyHKtFwBjAUMEugkLUo+xIPQ=="}} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:16:50.480206 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:16:50.480907 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:16:50.496425 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.quota [None req-d25c535c-705d-410b-a233-648db5796a4c tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Getting quotas for project b1730bdd7de14144bf75c92004923f9a. Resources: {'key_pairs'} {{(pid=117794) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:16:50.501642 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.quota [None req-d25c535c-705d-410b-a233-648db5796a4c tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Getting quotas for user c7b128ef63b94a71b7377a08aae7990f and project b1730bdd7de14144bf75c92004923f9a. Resources: {'key_pairs'} {{(pid=117794) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:16:50.532359 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-d25c535c-705d-410b-a233-648db5796a4c tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.060604 Jun 25 16:16:50.533127 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 458/921] 10.222.0.13 () {60 vars in 1158 bytes} [Sat Jun 25 16:16:50 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:16:50.593106 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=25 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:16:50.593864 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=49 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:16:50.599169 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-325671dc-c78c-4470-999c-4f0d2f873933 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1839806891", "imageRef": "339f31d2-f515-406f-a47d-ffd6ca370c3a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1770596430", "networks": [{"uuid": "695bd089-2bfd-4bbe-b1ed-d7cf1f841487"}]}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:16:50.657818 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-325671dc-c78c-4470-999c-4f0d2f873933 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] validate_networks() for [('695bd089-2bfd-4bbe-b1ed-d7cf1f841487', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 16:16:51.188236 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-325671dc-c78c-4470-999c-4f0d2f873933 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 16:16:51.189003 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-325671dc-c78c-4470-999c-4f0d2f873933 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 16:16:51.189776 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-325671dc-c78c-4470-999c-4f0d2f873933 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 16:16:51.190473 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-325671dc-c78c-4470-999c-4f0d2f873933 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 16:16:51.191303 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-325671dc-c78c-4470-999c-4f0d2f873933 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 16:16:51.203847 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-325671dc-c78c-4470-999c-4f0d2f873933 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:51.204314 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-325671dc-c78c-4470-999c-4f0d2f873933 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:51.205147 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-325671dc-c78c-4470-999c-4f0d2f873933 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:51.205586 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-325671dc-c78c-4470-999c-4f0d2f873933 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:51.225041 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-325671dc-c78c-4470-999c-4f0d2f873933 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Getting quotas for project b1730bdd7de14144bf75c92004923f9a. Resources: {'ram', 'cores', 'instances'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:16:51.229813 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-325671dc-c78c-4470-999c-4f0d2f873933 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Getting quotas for user c7b128ef63b94a71b7377a08aae7990f and project b1730bdd7de14144bf75c92004923f9a. Resources: {'ram', 'cores', 'instances'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:16:51.241143 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-325671dc-c78c-4470-999c-4f0d2f873933 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 16:16:51.244052 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-325671dc-c78c-4470-999c-4f0d2f873933 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='339f31d2-f515-406f-a47d-ffd6ca370c3a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 16:16:51.297024 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-325671dc-c78c-4470-999c-4f0d2f873933 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.706817 Jun 25 16:16:51.297675 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 464/922] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Jun 25 16:16:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 16:16:51.307980 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-d93bdb1e-15fb-4060-8a2a-309250300a8f tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:16:51.308639 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-d93bdb1e-15fb-4060-8a2a-309250300a8f tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:16:51.367846 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d93bdb1e-15fb-4060-8a2a-309250300a8f tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:16:51.375328 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-d93bdb1e-15fb-4060-8a2a-309250300a8f tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1259 microversion: 2.1 time: 0.071285 Jun 25 16:16:51.375919 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 459/923] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:16:51 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1259 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:16:52.393586 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-aa3f239c-feef-48bd-bf0d-39934bd1824a tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:16:52.394198 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-aa3f239c-feef-48bd-bf0d-39934bd1824a tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:16:52.401909 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aa3f239c-feef-48bd-bf0d-39934bd1824a tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:52.402356 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aa3f239c-feef-48bd-bf0d-39934bd1824a tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:52.403155 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aa3f239c-feef-48bd-bf0d-39934bd1824a tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:52.403586 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-aa3f239c-feef-48bd-bf0d-39934bd1824a tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:52.488504 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-aa3f239c-feef-48bd-bf0d-39934bd1824a tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:16:52.496693 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-aa3f239c-feef-48bd-bf0d-39934bd1824a tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1311 microversion: 2.1 time: 0.107769 Jun 25 16:16:52.497592 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 465/924] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:16:52 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1311 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:16:53.514705 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-514c0f16-724b-4c09-82e0-0434a02bf742 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:16:53.515303 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-514c0f16-724b-4c09-82e0-0434a02bf742 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:16:53.523161 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-514c0f16-724b-4c09-82e0-0434a02bf742 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:53.523614 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-514c0f16-724b-4c09-82e0-0434a02bf742 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:53.524402 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-514c0f16-724b-4c09-82e0-0434a02bf742 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:53.524858 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-514c0f16-724b-4c09-82e0-0434a02bf742 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:53.668801 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-514c0f16-724b-4c09-82e0-0434a02bf742 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:16:53.676310 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-514c0f16-724b-4c09-82e0-0434a02bf742 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1359 microversion: 2.1 time: 0.165806 Jun 25 16:16:53.676899 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 460/925] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:16:53 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:16:54.695495 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5af02d56-4031-4b47-8df5-190bf8cc4110 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:16:54.696199 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5af02d56-4031-4b47-8df5-190bf8cc4110 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:16:54.703851 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5af02d56-4031-4b47-8df5-190bf8cc4110 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:54.704443 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5af02d56-4031-4b47-8df5-190bf8cc4110 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:54.705358 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5af02d56-4031-4b47-8df5-190bf8cc4110 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:54.705867 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5af02d56-4031-4b47-8df5-190bf8cc4110 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:54.862880 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-5af02d56-4031-4b47-8df5-190bf8cc4110 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:16:54.871934 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5af02d56-4031-4b47-8df5-190bf8cc4110 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1359 microversion: 2.1 time: 0.179973 Jun 25 16:16:54.872841 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 466/926] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:16:54 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:16:55.889668 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-e5cc057c-9ff3-497c-8483-54d8a019de52 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:16:55.890390 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-e5cc057c-9ff3-497c-8483-54d8a019de52 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:16:55.897583 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e5cc057c-9ff3-497c-8483-54d8a019de52 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:55.898435 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e5cc057c-9ff3-497c-8483-54d8a019de52 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:55.899225 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e5cc057c-9ff3-497c-8483-54d8a019de52 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:55.899667 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e5cc057c-9ff3-497c-8483-54d8a019de52 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:56.034580 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-e5cc057c-9ff3-497c-8483-54d8a019de52 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:16:56.042821 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-e5cc057c-9ff3-497c-8483-54d8a019de52 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1359 microversion: 2.1 time: 0.157715 Jun 25 16:16:56.043600 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 461/927] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:16:55 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:16:57.060028 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-09c9250a-5a2c-4e75-87b9-4c2827198cdf tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:16:57.060666 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-09c9250a-5a2c-4e75-87b9-4c2827198cdf tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:16:57.067773 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-09c9250a-5a2c-4e75-87b9-4c2827198cdf tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:57.068229 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-09c9250a-5a2c-4e75-87b9-4c2827198cdf tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:57.069022 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-09c9250a-5a2c-4e75-87b9-4c2827198cdf tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:57.069466 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-09c9250a-5a2c-4e75-87b9-4c2827198cdf tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:57.394457 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-09c9250a-5a2c-4e75-87b9-4c2827198cdf tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:16:57.402650 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-09c9250a-5a2c-4e75-87b9-4c2827198cdf tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1359 microversion: 2.1 time: 0.346579 Jun 25 16:16:57.403238 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 467/928] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:16:57 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1359 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:16:58.419421 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-343adcc5-84b0-48bb-af71-c90de393fe3f tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:16:58.419995 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-343adcc5-84b0-48bb-af71-c90de393fe3f tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:16:58.426804 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-343adcc5-84b0-48bb-af71-c90de393fe3f tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:58.427248 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-343adcc5-84b0-48bb-af71-c90de393fe3f tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:58.428010 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-343adcc5-84b0-48bb-af71-c90de393fe3f tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:58.428450 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-343adcc5-84b0-48bb-af71-c90de393fe3f tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:58.571329 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-343adcc5-84b0-48bb-af71-c90de393fe3f tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:16:58.579134 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-343adcc5-84b0-48bb-af71-c90de393fe3f tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1359 microversion: 2.1 time: 0.163678 Jun 25 16:16:58.579677 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 462/929] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:16:58 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:16:59.596527 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-bd652a3f-082a-4173-b6c1-d0415c2fb994 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:16:59.597134 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-bd652a3f-082a-4173-b6c1-d0415c2fb994 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:16:59.604791 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd652a3f-082a-4173-b6c1-d0415c2fb994 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:59.605231 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd652a3f-082a-4173-b6c1-d0415c2fb994 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:59.606007 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd652a3f-082a-4173-b6c1-d0415c2fb994 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:16:59.606439 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-bd652a3f-082a-4173-b6c1-d0415c2fb994 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:16:59.739665 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-bd652a3f-082a-4173-b6c1-d0415c2fb994 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:16:59.747447 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-bd652a3f-082a-4173-b6c1-d0415c2fb994 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1359 microversion: 2.1 time: 0.154853 Jun 25 16:16:59.748013 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 468/930] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:16:59 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:17:00.766093 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-11ab4fba-6a7f-4fa4-8fef-aed2450ae1b1 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:17:00.766825 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-11ab4fba-6a7f-4fa4-8fef-aed2450ae1b1 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:17:00.775014 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-11ab4fba-6a7f-4fa4-8fef-aed2450ae1b1 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:00.775564 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-11ab4fba-6a7f-4fa4-8fef-aed2450ae1b1 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:00.776469 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-11ab4fba-6a7f-4fa4-8fef-aed2450ae1b1 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:00.777016 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-11ab4fba-6a7f-4fa4-8fef-aed2450ae1b1 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:00.914404 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-11ab4fba-6a7f-4fa4-8fef-aed2450ae1b1 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:17:00.922207 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-11ab4fba-6a7f-4fa4-8fef-aed2450ae1b1 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1359 microversion: 2.1 time: 0.161094 Jun 25 16:17:00.922766 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 463/931] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:17:00 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:17:01.634875 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:17:01.635686 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=6 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:17:01.831531 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-297f5327-89f8-40a3-bdc6-c8c985b67766 req-41602032-63ae-44a5-89b3-5935b5c86166 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3466d47-427c-4fde-9c19-90aea43be44b", "tag": "a95cf970-c715-4dd2-84f4-761293704f29"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:17:01.846143 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-297f5327-89f8-40a3-bdc6-c8c985b67766 req-41602032-63ae-44a5-89b3-5935b5c86166 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:01.846587 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-297f5327-89f8-40a3-bdc6-c8c985b67766 req-41602032-63ae-44a5-89b3-5935b5c86166 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:01.864592 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-297f5327-89f8-40a3-bdc6-c8c985b67766 req-41602032-63ae-44a5-89b3-5935b5c86166 service nova] Creating event network-changed:a95cf970-c715-4dd2-84f4-761293704f29 for instance a3466d47-427c-4fde-9c19-90aea43be44b on hv-cinder-84762 Jun 25 16:17:01.873597 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-297f5327-89f8-40a3-bdc6-c8c985b67766 req-41602032-63ae-44a5-89b3-5935b5c86166 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.245711 Jun 25 16:17:01.874571 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 469/932] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:17:01.939229 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-992461f7-5835-45e3-8d12-ed80218e9681 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:17:01.939898 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-992461f7-5835-45e3-8d12-ed80218e9681 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:17:01.941719 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell0:SELECT=6 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:17:01.949179 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-992461f7-5835-45e3-8d12-ed80218e9681 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:01.950270 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-992461f7-5835-45e3-8d12-ed80218e9681 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:01.951062 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-992461f7-5835-45e3-8d12-ed80218e9681 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:01.951507 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-992461f7-5835-45e3-8d12-ed80218e9681 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:02.148442 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-992461f7-5835-45e3-8d12-ed80218e9681 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:17:02.156170 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-992461f7-5835-45e3-8d12-ed80218e9681 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1359 microversion: 2.1 time: 0.220851 Jun 25 16:17:02.156771 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 464/933] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:17:01 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1359 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:17:03.174420 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-31c61bb3-a142-46a5-89c2-eb0abeb85ac1 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:17:03.175107 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-31c61bb3-a142-46a5-89c2-eb0abeb85ac1 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:17:03.181793 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-31c61bb3-a142-46a5-89c2-eb0abeb85ac1 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:03.182238 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-31c61bb3-a142-46a5-89c2-eb0abeb85ac1 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:03.183002 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-31c61bb3-a142-46a5-89c2-eb0abeb85ac1 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:03.183427 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-31c61bb3-a142-46a5-89c2-eb0abeb85ac1 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:03.389197 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-31c61bb3-a142-46a5-89c2-eb0abeb85ac1 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:17:03.396890 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-31c61bb3-a142-46a5-89c2-eb0abeb85ac1 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1359 microversion: 2.1 time: 0.227113 Jun 25 16:17:03.397701 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 470/934] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:17:03 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1359 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:17:04.417636 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-72594fb0-c577-4ceb-a31a-b405cbb42008 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:17:04.418612 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-72594fb0-c577-4ceb-a31a-b405cbb42008 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:17:04.429656 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-72594fb0-c577-4ceb-a31a-b405cbb42008 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:04.430194 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-72594fb0-c577-4ceb-a31a-b405cbb42008 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:04.430966 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-72594fb0-c577-4ceb-a31a-b405cbb42008 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:04.431396 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-72594fb0-c577-4ceb-a31a-b405cbb42008 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:04.566936 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-72594fb0-c577-4ceb-a31a-b405cbb42008 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:17:04.574966 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-72594fb0-c577-4ceb-a31a-b405cbb42008 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1359 microversion: 2.1 time: 0.163896 Jun 25 16:17:04.575522 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 465/935] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:17:04 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:17:05.593850 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-68cfc0b0-4872-41dc-abd2-e6e33d8ff2b9 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:17:05.594476 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-68cfc0b0-4872-41dc-abd2-e6e33d8ff2b9 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:17:05.601178 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-68cfc0b0-4872-41dc-abd2-e6e33d8ff2b9 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:05.601749 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-68cfc0b0-4872-41dc-abd2-e6e33d8ff2b9 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:05.602533 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-68cfc0b0-4872-41dc-abd2-e6e33d8ff2b9 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:05.603027 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-68cfc0b0-4872-41dc-abd2-e6e33d8ff2b9 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:05.741052 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-68cfc0b0-4872-41dc-abd2-e6e33d8ff2b9 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:17:05.750634 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-68cfc0b0-4872-41dc-abd2-e6e33d8ff2b9 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1359 microversion: 2.1 time: 0.159061 Jun 25 16:17:05.751254 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 471/936] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:17:05 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:17:06.768317 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-86017e0f-5570-4129-9cc0-0ab509a116f5 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:17:06.768983 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-86017e0f-5570-4129-9cc0-0ab509a116f5 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:17:06.776473 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-86017e0f-5570-4129-9cc0-0ab509a116f5 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:06.776968 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-86017e0f-5570-4129-9cc0-0ab509a116f5 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:06.777805 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-86017e0f-5570-4129-9cc0-0ab509a116f5 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:06.778260 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-86017e0f-5570-4129-9cc0-0ab509a116f5 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:06.910991 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-86017e0f-5570-4129-9cc0-0ab509a116f5 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:17:06.919118 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-86017e0f-5570-4129-9cc0-0ab509a116f5 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1359 microversion: 2.1 time: 0.155451 Jun 25 16:17:06.919665 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 466/937] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:17:06 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:17:07.183906 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-b91a0140-692a-426f-b477-1576a3f3d51c req-c3988019-d5c4-4064-8736-99981da654e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3466d47-427c-4fde-9c19-90aea43be44b", "name": "network-vif-plugged", "status": "completed", "tag": "a95cf970-c715-4dd2-84f4-761293704f29"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:17:07.194167 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-b91a0140-692a-426f-b477-1576a3f3d51c req-c3988019-d5c4-4064-8736-99981da654e7 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:07.195015 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-b91a0140-692a-426f-b477-1576a3f3d51c req-c3988019-d5c4-4064-8736-99981da654e7 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:07.211230 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-b91a0140-692a-426f-b477-1576a3f3d51c req-c3988019-d5c4-4064-8736-99981da654e7 service nova] Creating event network-vif-plugged:a95cf970-c715-4dd2-84f4-761293704f29 for instance a3466d47-427c-4fde-9c19-90aea43be44b on hv-cinder-84762 Jun 25 16:17:07.216134 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-b91a0140-692a-426f-b477-1576a3f3d51c req-c3988019-d5c4-4064-8736-99981da654e7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036259 Jun 25 16:17:07.216761 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 472/938] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:17:07.937897 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-af992482-4994-45af-9f3a-fd3f2f2389bf tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:17:07.938662 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-af992482-4994-45af-9f3a-fd3f2f2389bf tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:17:07.948022 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-af992482-4994-45af-9f3a-fd3f2f2389bf tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:07.948673 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-af992482-4994-45af-9f3a-fd3f2f2389bf tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:07.949662 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-af992482-4994-45af-9f3a-fd3f2f2389bf tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:07.950264 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-af992482-4994-45af-9f3a-fd3f2f2389bf tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:08.090747 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-af992482-4994-45af-9f3a-fd3f2f2389bf tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:17:08.102505 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-af992482-4994-45af-9f3a-fd3f2f2389bf tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1359 microversion: 2.1 time: 0.169228 Jun 25 16:17:08.103280 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 467/939] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:17:07 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:17:09.124602 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-0701d085-a24a-494c-8067-aab2c66979ee tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:17:09.125658 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0701d085-a24a-494c-8067-aab2c66979ee tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:17:09.134925 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0701d085-a24a-494c-8067-aab2c66979ee tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:09.135376 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0701d085-a24a-494c-8067-aab2c66979ee tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:09.136135 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0701d085-a24a-494c-8067-aab2c66979ee tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:09.136612 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0701d085-a24a-494c-8067-aab2c66979ee tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:09.270725 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-0701d085-a24a-494c-8067-aab2c66979ee tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:17:09.278413 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-0701d085-a24a-494c-8067-aab2c66979ee tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1548 microversion: 2.1 time: 0.161866 Jun 25 16:17:09.278953 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 473/940] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:17:09 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1548 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:17:09.294892 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-a7e564cb-4ad2-49d9-9dcc-aae32e2a1b36 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:17:09.295499 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-a7e564cb-4ad2-49d9-9dcc-aae32e2a1b36 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:17:09.302177 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a7e564cb-4ad2-49d9-9dcc-aae32e2a1b36 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:09.302629 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a7e564cb-4ad2-49d9-9dcc-aae32e2a1b36 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:09.303391 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a7e564cb-4ad2-49d9-9dcc-aae32e2a1b36 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:09.303935 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a7e564cb-4ad2-49d9-9dcc-aae32e2a1b36 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:09.437291 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-a7e564cb-4ad2-49d9-9dcc-aae32e2a1b36 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:17:09.447618 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-a7e564cb-4ad2-49d9-9dcc-aae32e2a1b36 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1548 microversion: 2.1 time: 0.156439 Jun 25 16:17:09.448268 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 468/941] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:17:09 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:17:09.468335 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-492652bb-2f0b-4671-a72d-86591944ca59 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:17:09.471718 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-492652bb-2f0b-4671-a72d-86591944ca59 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:17:09.472555 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-492652bb-2f0b-4671-a72d-86591944ca59 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Searching by: {'deleted': False, 'project_id': 'b1730bdd7de14144bf75c92004923f9a'} {{(pid=117793) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 25 16:17:09.479995 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-492652bb-2f0b-4671-a72d-86591944ca59 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:09.480451 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-492652bb-2f0b-4671-a72d-86591944ca59 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:09.481265 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-492652bb-2f0b-4671-a72d-86591944ca59 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:09.481700 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-492652bb-2f0b-4671-a72d-86591944ca59 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:09.570228 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.multi_cell_list [None req-492652bb-2f0b-4671-a72d-86591944ca59 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117793) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 25 16:17:09.662165 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-492652bb-2f0b-4671-a72d-86591944ca59 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.197441 Jun 25 16:17:09.662664 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 474/942] 10.222.0.13 () {58 vars in 1124 bytes} [Sat Jun 25 16:17:09 2022] GET /compute/v2.1/servers => generated 343 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:17:09.673182 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-5f2a2f34-4070-4a69-8d89-c648def1b572 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:17:09.673785 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-5f2a2f34-4070-4a69-8d89-c648def1b572 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:17:09.680973 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5f2a2f34-4070-4a69-8d89-c648def1b572 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:09.681424 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5f2a2f34-4070-4a69-8d89-c648def1b572 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:09.682269 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5f2a2f34-4070-4a69-8d89-c648def1b572 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:09.682702 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5f2a2f34-4070-4a69-8d89-c648def1b572 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:09.821039 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-5f2a2f34-4070-4a69-8d89-c648def1b572 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:17:09.829507 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-5f2a2f34-4070-4a69-8d89-c648def1b572 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1548 microversion: 2.1 time: 0.160164 Jun 25 16:17:09.830067 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 469/943] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:17:09 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1548 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:17:11.383631 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-0922ed89-aeb8-4473-a5bb-c428cfa5ebd2 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d6b5e9e-026d-47a9-abcd-53d64c501e61"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:17:11.384727 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0922ed89-aeb8-4473-a5bb-c428cfa5ebd2 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:17:11.391681 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0922ed89-aeb8-4473-a5bb-c428cfa5ebd2 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:11.392125 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0922ed89-aeb8-4473-a5bb-c428cfa5ebd2 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:11.392921 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0922ed89-aeb8-4473-a5bb-c428cfa5ebd2 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:11.393351 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0922ed89-aeb8-4473-a5bb-c428cfa5ebd2 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:11.649801 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-0922ed89-aeb8-4473-a5bb-c428cfa5ebd2 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "POST /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270201 Jun 25 16:17:11.650409 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 475/944] 10.222.0.13 () {60 vars in 1322 bytes} [Sat Jun 25 16:17:11 2022] POST /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:17:18.181814 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-0ad1a8ab-5463-4230-9ce8-42e7d4a7304a tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:17:18.182392 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-0ad1a8ab-5463-4230-9ce8-42e7d4a7304a tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:17:18.189205 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0ad1a8ab-5463-4230-9ce8-42e7d4a7304a tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:18.189659 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0ad1a8ab-5463-4230-9ce8-42e7d4a7304a tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:18.190428 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0ad1a8ab-5463-4230-9ce8-42e7d4a7304a tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:18.190867 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-0ad1a8ab-5463-4230-9ce8-42e7d4a7304a tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:18.387185 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-0ad1a8ab-5463-4230-9ce8-42e7d4a7304a tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:17:18.395860 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-0ad1a8ab-5463-4230-9ce8-42e7d4a7304a tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1594 microversion: 2.1 time: 0.218141 Jun 25 16:17:18.396703 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 470/945] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:17:18 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1594 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:17:20.281051 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:17:20.342176 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-3c6b05a8-1eb3-406c-a628-c479daad881b req-87e0e413-1214-45ba-8038-b12203c5bef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3466d47-427c-4fde-9c19-90aea43be44b", "tag": "a95cf970-c715-4dd2-84f4-761293704f29"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:17:20.352387 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-3c6b05a8-1eb3-406c-a628-c479daad881b req-87e0e413-1214-45ba-8038-b12203c5bef0 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:20.352846 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-3c6b05a8-1eb3-406c-a628-c479daad881b req-87e0e413-1214-45ba-8038-b12203c5bef0 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:20.364517 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-3c6b05a8-1eb3-406c-a628-c479daad881b req-87e0e413-1214-45ba-8038-b12203c5bef0 service nova] Creating event network-changed:a95cf970-c715-4dd2-84f4-761293704f29 for instance a3466d47-427c-4fde-9c19-90aea43be44b on hv-cinder-84762 Jun 25 16:17:20.369768 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-3c6b05a8-1eb3-406c-a628-c479daad881b req-87e0e413-1214-45ba-8038-b12203c5bef0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094162 Jun 25 16:17:20.370820 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 476/946] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:17:21.568486 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-774832eb-fd35-45e9-b0d6-0125e540ed05 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1380889855"}} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:17:21.569090 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-774832eb-fd35-45e9-b0d6-0125e540ed05 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:17:21.571497 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:17:21.577553 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-774832eb-fd35-45e9-b0d6-0125e540ed05 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:21.578000 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-774832eb-fd35-45e9-b0d6-0125e540ed05 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:21.578747 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-774832eb-fd35-45e9-b0d6-0125e540ed05 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:21.579203 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-774832eb-fd35-45e9-b0d6-0125e540ed05 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:21.582123 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=67 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:17:21.717010 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.network.security_group_api [None req-774832eb-fd35-45e9-b0d6-0125e540ed05 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Adding security group c4e1adc0-200b-47ae-bd2c-ec1bddadbcaa to port a95cf970-c715-4dd2-84f4-761293704f29 Jun 25 16:17:22.079998 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-774832eb-fd35-45e9-b0d6-0125e540ed05 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "POST /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b/action" status: 202 len: 0 microversion: 2.1 time: 0.515436 Jun 25 16:17:22.080620 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 471/947] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Jun 25 16:17:21 2022] POST /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b/action => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 16:17:22.097644 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2feebcd7-a394-49f5-8f3e-aa98c1da4b81 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:17:22.098556 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-af6215b4-8a0c-417e-84f6-3b16ab3bded3 req-6ea0444e-531c-4f3f-81fe-58049e70c354 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3466d47-427c-4fde-9c19-90aea43be44b", "tag": "a95cf970-c715-4dd2-84f4-761293704f29"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:17:22.104702 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2feebcd7-a394-49f5-8f3e-aa98c1da4b81 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:17:22.108863 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:17:22.115829 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-af6215b4-8a0c-417e-84f6-3b16ab3bded3 req-6ea0444e-531c-4f3f-81fe-58049e70c354 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:22.116063 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-af6215b4-8a0c-417e-84f6-3b16ab3bded3 req-6ea0444e-531c-4f3f-81fe-58049e70c354 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:22.120841 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2feebcd7-a394-49f5-8f3e-aa98c1da4b81 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:22.121296 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2feebcd7-a394-49f5-8f3e-aa98c1da4b81 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:22.122074 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2feebcd7-a394-49f5-8f3e-aa98c1da4b81 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:22.122512 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2feebcd7-a394-49f5-8f3e-aa98c1da4b81 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:22.127756 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:17:22.132652 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-af6215b4-8a0c-417e-84f6-3b16ab3bded3 req-6ea0444e-531c-4f3f-81fe-58049e70c354 service nova] Creating event network-changed:a95cf970-c715-4dd2-84f4-761293704f29 for instance a3466d47-427c-4fde-9c19-90aea43be44b on hv-cinder-84762 Jun 25 16:17:22.140668 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-af6215b4-8a0c-417e-84f6-3b16ab3bded3 req-6ea0444e-531c-4f3f-81fe-58049e70c354 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051153 Jun 25 16:17:22.141868 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 472/948] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:17:22.379239 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2feebcd7-a394-49f5-8f3e-aa98c1da4b81 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:17:22.388259 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2feebcd7-a394-49f5-8f3e-aa98c1da4b81 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1760 microversion: 2.1 time: 0.302601 Jun 25 16:17:22.389669 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 477/949] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:17:22 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1760 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:17:45.047012 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-cfabe9c1-bfe9-452d-b7c5-1449e39bcbe8 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:17:45.047962 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-cfabe9c1-bfe9-452d-b7c5-1449e39bcbe8 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:17:45.050228 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_api:SELECT=3 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:17:45.050860 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=5 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:17:45.057584 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cfabe9c1-bfe9-452d-b7c5-1449e39bcbe8 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:45.058038 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cfabe9c1-bfe9-452d-b7c5-1449e39bcbe8 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:45.058804 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cfabe9c1-bfe9-452d-b7c5-1449e39bcbe8 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:45.059271 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cfabe9c1-bfe9-452d-b7c5-1449e39bcbe8 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:45.148166 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-cfabe9c1-bfe9-452d-b7c5-1449e39bcbe8 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "POST /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b/action" status: 202 len: 0 microversion: 2.1 time: 0.105310 Jun 25 16:17:45.149001 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 473/950] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Jun 25 16:17:45 2022] POST /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 16:17:45.159006 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-c8de3512-127e-49c8-b547-5c334e20b43b tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:17:45.159468 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-c8de3512-127e-49c8-b547-5c334e20b43b tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:17:45.162537 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:17:45.163771 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=5 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:17:45.169310 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c8de3512-127e-49c8-b547-5c334e20b43b tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:45.169740 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c8de3512-127e-49c8-b547-5c334e20b43b tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:45.170525 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c8de3512-127e-49c8-b547-5c334e20b43b tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:45.170994 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-c8de3512-127e-49c8-b547-5c334e20b43b tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:45.340276 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-c8de3512-127e-49c8-b547-5c334e20b43b tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:17:45.354076 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-c8de3512-127e-49c8-b547-5c334e20b43b tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1752 microversion: 2.1 time: 0.199552 Jun 25 16:17:45.354823 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 478/951] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:17:45 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1752 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:17:46.382124 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-308b71ed-4f2c-4806-9606-07a6c28c8677 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:17:46.383267 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-308b71ed-4f2c-4806-9606-07a6c28c8677 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:17:46.394275 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-308b71ed-4f2c-4806-9606-07a6c28c8677 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:46.395019 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-308b71ed-4f2c-4806-9606-07a6c28c8677 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:46.396291 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-308b71ed-4f2c-4806-9606-07a6c28c8677 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:46.397105 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-308b71ed-4f2c-4806-9606-07a6c28c8677 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:46.547511 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-308b71ed-4f2c-4806-9606-07a6c28c8677 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:17:46.556241 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-308b71ed-4f2c-4806-9606-07a6c28c8677 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1752 microversion: 2.1 time: 0.182064 Jun 25 16:17:46.556855 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 474/952] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:17:46 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1752 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:17:47.577851 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-018c823e-8335-469a-96ec-3509daad8227 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:17:47.578768 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-018c823e-8335-469a-96ec-3509daad8227 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:17:47.587960 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-018c823e-8335-469a-96ec-3509daad8227 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:47.588262 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-018c823e-8335-469a-96ec-3509daad8227 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:47.589062 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-018c823e-8335-469a-96ec-3509daad8227 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:47.589493 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-018c823e-8335-469a-96ec-3509daad8227 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:47.810435 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-018c823e-8335-469a-96ec-3509daad8227 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:17:47.818925 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-018c823e-8335-469a-96ec-3509daad8227 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1752 microversion: 2.1 time: 0.247440 Jun 25 16:17:47.819783 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 479/953] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:17:47 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1752 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:17:48.841795 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-f98de398-e441-4b7e-8ee7-bf854385a77b tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:17:48.842916 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-f98de398-e441-4b7e-8ee7-bf854385a77b tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:17:48.852443 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f98de398-e441-4b7e-8ee7-bf854385a77b tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:48.853005 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f98de398-e441-4b7e-8ee7-bf854385a77b tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:48.853780 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f98de398-e441-4b7e-8ee7-bf854385a77b tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:48.854223 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f98de398-e441-4b7e-8ee7-bf854385a77b tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:49.001409 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-f98de398-e441-4b7e-8ee7-bf854385a77b tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:17:49.009763 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-f98de398-e441-4b7e-8ee7-bf854385a77b tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1757 microversion: 2.1 time: 0.174463 Jun 25 16:17:49.010331 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 475/954] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:17:48 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:17:50.031988 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-ce8549d2-9197-4462-bdb3-4b8b54b4e334 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:17:50.033011 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-ce8549d2-9197-4462-bdb3-4b8b54b4e334 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:17:50.045098 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ce8549d2-9197-4462-bdb3-4b8b54b4e334 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:50.045883 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ce8549d2-9197-4462-bdb3-4b8b54b4e334 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:50.047135 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ce8549d2-9197-4462-bdb3-4b8b54b4e334 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:50.047849 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-ce8549d2-9197-4462-bdb3-4b8b54b4e334 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:50.205276 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-ce8549d2-9197-4462-bdb3-4b8b54b4e334 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:17:50.214116 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-ce8549d2-9197-4462-bdb3-4b8b54b4e334 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1757 microversion: 2.1 time: 0.188643 Jun 25 16:17:50.214676 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 480/955] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:17:50 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1757 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:17:51.231951 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-f2e9ca1e-f423-4def-b1cd-1a263dfc50e2 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:17:51.232590 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-f2e9ca1e-f423-4def-b1cd-1a263dfc50e2 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:17:51.239602 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f2e9ca1e-f423-4def-b1cd-1a263dfc50e2 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:51.240053 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f2e9ca1e-f423-4def-b1cd-1a263dfc50e2 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:51.240904 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f2e9ca1e-f423-4def-b1cd-1a263dfc50e2 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:51.241356 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f2e9ca1e-f423-4def-b1cd-1a263dfc50e2 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:51.391625 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-f2e9ca1e-f423-4def-b1cd-1a263dfc50e2 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:17:51.399796 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-f2e9ca1e-f423-4def-b1cd-1a263dfc50e2 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1757 microversion: 2.1 time: 0.172002 Jun 25 16:17:51.400354 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 476/956] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:17:51 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1757 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:17:51.750665 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-e150f0cc-6b88-479d-8f66-c22ee6a7f408 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1694839776", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-38770479", "security_groups": [{"name": "tempest-secgroup-smoke-1054987293"}], "block_device_mapping_v2": [{"uuid": "562fa876-11dc-4d7f-8a41-c997a7f0476f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "4493f90c-02cf-4ced-9f9f-700abb5cb837"}]}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:17:51.877654 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.network.neutron [None req-e150f0cc-6b88-479d-8f66-c22ee6a7f408 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] validate_networks() for [('4493f90c-02cf-4ced-9f9f-700abb5cb837', None, None, None, None, None)] {{(pid=117793) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 25 16:17:52.257107 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-e150f0cc-6b88-479d-8f66-c22ee6a7f408 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Flavor limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 25 16:17:52.257567 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-e150f0cc-6b88-479d-8f66-c22ee6a7f408 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Image limits 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 25 16:17:52.258041 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-e150f0cc-6b88-479d-8f66-c22ee6a7f408 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Flavor pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 25 16:17:52.258468 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-e150f0cc-6b88-479d-8f66-c22ee6a7f408 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Image pref 0:0:0 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 25 16:17:52.258873 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.virt.hardware [None req-e150f0cc-6b88-479d-8f66-c22ee6a7f408 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117793) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 25 16:17:52.268775 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e150f0cc-6b88-479d-8f66-c22ee6a7f408 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:52.269193 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e150f0cc-6b88-479d-8f66-c22ee6a7f408 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:52.269983 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e150f0cc-6b88-479d-8f66-c22ee6a7f408 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:52.270418 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-e150f0cc-6b88-479d-8f66-c22ee6a7f408 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:52.287394 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-e150f0cc-6b88-479d-8f66-c22ee6a7f408 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Getting quotas for project c5bb30b042f3422faf43af82b27b37a5. Resources: {'ram', 'cores', 'instances'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 25 16:17:52.291864 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.quota [None req-e150f0cc-6b88-479d-8f66-c22ee6a7f408 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Getting quotas for user 0ef599055aed42f3a97fb30bba553fb0 and project c5bb30b042f3422faf43af82b27b37a5. Resources: {'ram', 'cores', 'instances'} {{(pid=117793) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 25 16:17:52.351503 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e150f0cc-6b88-479d-8f66-c22ee6a7f408 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Going to run 1 instances... {{(pid=117793) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 25 16:17:52.353640 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-e150f0cc-6b88-479d-8f66-c22ee6a7f408 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 552a9dd3-f749-4a67-afdb-1d4a206c7046] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='562fa876-11dc-4d7f-8a41-c997a7f0476f',volume_size=None,volume_type=None)] {{(pid=117793) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 25 16:17:52.416657 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-cfeccbb6-0fc5-4797-b043-088743bbefdd tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:17:52.417265 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-cfeccbb6-0fc5-4797-b043-088743bbefdd tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:17:52.423797 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cfeccbb6-0fc5-4797-b043-088743bbefdd tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:52.424245 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cfeccbb6-0fc5-4797-b043-088743bbefdd tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:52.425045 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cfeccbb6-0fc5-4797-b043-088743bbefdd tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:52.425483 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-cfeccbb6-0fc5-4797-b043-088743bbefdd tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:52.486764 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-e150f0cc-6b88-479d-8f66-c22ee6a7f408 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.744032 Jun 25 16:17:52.487639 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 481/957] 10.222.0.13 () {60 vars in 1146 bytes} [Sat Jun 25 16:17:51 2022] POST /compute/v2.1/servers => generated 406 bytes in 746 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 25 16:17:52.498132 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f622d10a-40d4-4130-88cd-b94f5988931b tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:17:52.498729 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f622d10a-40d4-4130-88cd-b94f5988931b tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 552a9dd3-f749-4a67-afdb-1d4a206c7046] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:17:52.571688 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-f622d10a-40d4-4130-88cd-b94f5988931b tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:17:52.578323 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f622d10a-40d4-4130-88cd-b94f5988931b tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046" status: 200 len: 1093 microversion: 2.1 time: 0.084098 Jun 25 16:17:52.584458 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 482/958] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:17:52 2022] GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046 => generated 1093 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:17:52.617776 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-cfeccbb6-0fc5-4797-b043-088743bbefdd tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:17:52.625774 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-cfeccbb6-0fc5-4797-b043-088743bbefdd tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1757 microversion: 2.1 time: 0.213099 Jun 25 16:17:52.626317 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 477/959] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:17:52 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1757 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 25 16:17:53.595095 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-7aa85baf-e4e0-49c8-8ccc-5ddc404455d5 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:17:53.595706 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-7aa85baf-e4e0-49c8-8ccc-5ddc404455d5 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 552a9dd3-f749-4a67-afdb-1d4a206c7046] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:17:53.602907 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7aa85baf-e4e0-49c8-8ccc-5ddc404455d5 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:53.603380 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7aa85baf-e4e0-49c8-8ccc-5ddc404455d5 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:53.604150 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7aa85baf-e4e0-49c8-8ccc-5ddc404455d5 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:53.604618 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-7aa85baf-e4e0-49c8-8ccc-5ddc404455d5 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:53.643511 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-b0711352-d249-4375-af5b-c9b44632a016 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:17:53.644106 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-b0711352-d249-4375-af5b-c9b44632a016 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:17:53.651712 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b0711352-d249-4375-af5b-c9b44632a016 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:53.652160 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b0711352-d249-4375-af5b-c9b44632a016 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:53.652965 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b0711352-d249-4375-af5b-c9b44632a016 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:53.653400 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-b0711352-d249-4375-af5b-c9b44632a016 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:53.701795 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-7aa85baf-e4e0-49c8-8ccc-5ddc404455d5 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:17:53.710289 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-7aa85baf-e4e0-49c8-8ccc-5ddc404455d5 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046" status: 200 len: 1209 microversion: 2.1 time: 0.118369 Jun 25 16:17:53.710884 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 483/960] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:17:53 2022] GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046 => generated 1209 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:17:53.905659 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-b0711352-d249-4375-af5b-c9b44632a016 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:17:53.914683 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-b0711352-d249-4375-af5b-c9b44632a016 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1757 microversion: 2.1 time: 0.275181 Jun 25 16:17:53.915600 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 478/961] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:17:53 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1757 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:17:54.728426 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-074171a7-15c4-4424-a6b7-426f69b8300c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:17:54.729040 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-074171a7-15c4-4424-a6b7-426f69b8300c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 552a9dd3-f749-4a67-afdb-1d4a206c7046] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:17:54.736683 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-074171a7-15c4-4424-a6b7-426f69b8300c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:54.737207 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-074171a7-15c4-4424-a6b7-426f69b8300c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:54.738248 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-074171a7-15c4-4424-a6b7-426f69b8300c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:54.738807 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-074171a7-15c4-4424-a6b7-426f69b8300c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:54.932273 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-2b8ae6b2-91b7-4f54-893f-fb8c9af917fd tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:17:54.932916 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-2b8ae6b2-91b7-4f54-893f-fb8c9af917fd tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:17:54.938870 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2b8ae6b2-91b7-4f54-893f-fb8c9af917fd tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:54.939628 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2b8ae6b2-91b7-4f54-893f-fb8c9af917fd tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:54.940668 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2b8ae6b2-91b7-4f54-893f-fb8c9af917fd tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:54.941170 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-2b8ae6b2-91b7-4f54-893f-fb8c9af917fd tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:54.973503 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-074171a7-15c4-4424-a6b7-426f69b8300c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:17:54.982236 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-074171a7-15c4-4424-a6b7-426f69b8300c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046" status: 200 len: 1265 microversion: 2.1 time: 0.258134 Jun 25 16:17:54.983430 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 484/962] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:17:54 2022] GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046 => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:17:55.162834 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-2b8ae6b2-91b7-4f54-893f-fb8c9af917fd tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:17:55.174496 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-2b8ae6b2-91b7-4f54-893f-fb8c9af917fd tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1757 microversion: 2.1 time: 0.245732 Jun 25 16:17:55.186478 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 479/963] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:17:54 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1757 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:17:55.205257 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-813200dd-88db-4286-86ae-f756a8d71057 req-ea77ceaa-06db-4fbc-b7c6-2725f307847f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "552a9dd3-f749-4a67-afdb-1d4a206c7046", "tag": "107462c9-7523-4740-bf19-c9c6fec3b93d"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:17:55.224334 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-813200dd-88db-4286-86ae-f756a8d71057 req-ea77ceaa-06db-4fbc-b7c6-2725f307847f service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:55.225026 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-813200dd-88db-4286-86ae-f756a8d71057 req-ea77ceaa-06db-4fbc-b7c6-2725f307847f service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:55.237459 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-813200dd-88db-4286-86ae-f756a8d71057 req-ea77ceaa-06db-4fbc-b7c6-2725f307847f service nova] Creating event network-changed:107462c9-7523-4740-bf19-c9c6fec3b93d for instance 552a9dd3-f749-4a67-afdb-1d4a206c7046 on hv-cinder-84762 Jun 25 16:17:55.242533 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-813200dd-88db-4286-86ae-f756a8d71057 req-ea77ceaa-06db-4fbc-b7c6-2725f307847f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040946 Jun 25 16:17:55.243134 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 485/964] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:17:55.999398 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-1b349270-360d-4a13-8fc1-4d7828d7c74b tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:17:56.000125 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-1b349270-360d-4a13-8fc1-4d7828d7c74b tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 552a9dd3-f749-4a67-afdb-1d4a206c7046] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:17:56.007347 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1b349270-360d-4a13-8fc1-4d7828d7c74b tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:56.007804 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1b349270-360d-4a13-8fc1-4d7828d7c74b tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:56.008620 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1b349270-360d-4a13-8fc1-4d7828d7c74b tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:56.009055 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-1b349270-360d-4a13-8fc1-4d7828d7c74b tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:56.194606 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-a8970d6a-5e7a-4013-a5a9-8250393a7bef tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:17:56.195304 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-a8970d6a-5e7a-4013-a5a9-8250393a7bef tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:17:56.202357 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a8970d6a-5e7a-4013-a5a9-8250393a7bef tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:56.204144 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a8970d6a-5e7a-4013-a5a9-8250393a7bef tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:56.205200 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a8970d6a-5e7a-4013-a5a9-8250393a7bef tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:56.205384 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-a8970d6a-5e7a-4013-a5a9-8250393a7bef tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:56.572919 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-a8970d6a-5e7a-4013-a5a9-8250393a7bef tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:17:56.576019 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-1b349270-360d-4a13-8fc1-4d7828d7c74b tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:17:56.581261 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-a8970d6a-5e7a-4013-a5a9-8250393a7bef tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1757 microversion: 2.1 time: 0.391432 Jun 25 16:17:56.586111 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 486/965] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:17:56 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1757 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:17:56.588678 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-1b349270-360d-4a13-8fc1-4d7828d7c74b tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046" status: 200 len: 1265 microversion: 2.1 time: 0.593125 Jun 25 16:17:56.589473 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 480/966] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:17:55 2022] GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046 => generated 1265 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:17:57.604594 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-1aefd6e6-0455-44e7-a1e1-ed3ccc33a8ab tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:17:57.605530 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-1aefd6e6-0455-44e7-a1e1-ed3ccc33a8ab tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:17:57.610036 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-8bb07a5c-b1b2-4d7a-a894-ca19f83bf23a tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:17:57.611840 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-8bb07a5c-b1b2-4d7a-a894-ca19f83bf23a tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 552a9dd3-f749-4a67-afdb-1d4a206c7046] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:17:57.616423 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1aefd6e6-0455-44e7-a1e1-ed3ccc33a8ab tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:57.616901 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1aefd6e6-0455-44e7-a1e1-ed3ccc33a8ab tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:57.617675 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1aefd6e6-0455-44e7-a1e1-ed3ccc33a8ab tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:57.618164 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-1aefd6e6-0455-44e7-a1e1-ed3ccc33a8ab tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:57.619447 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8bb07a5c-b1b2-4d7a-a894-ca19f83bf23a tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:57.620093 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8bb07a5c-b1b2-4d7a-a894-ca19f83bf23a tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:57.621107 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8bb07a5c-b1b2-4d7a-a894-ca19f83bf23a tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:57.621543 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-8bb07a5c-b1b2-4d7a-a894-ca19f83bf23a tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:57.837860 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-8bb07a5c-b1b2-4d7a-a894-ca19f83bf23a tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:17:57.845008 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-1aefd6e6-0455-44e7-a1e1-ed3ccc33a8ab tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:17:57.846040 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-8bb07a5c-b1b2-4d7a-a894-ca19f83bf23a tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046" status: 200 len: 1265 microversion: 2.1 time: 0.242445 Jun 25 16:17:57.846915 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 481/967] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:17:57 2022] GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046 => generated 1265 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:17:57.857716 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-1aefd6e6-0455-44e7-a1e1-ed3ccc33a8ab tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1757 microversion: 2.1 time: 0.259465 Jun 25 16:17:57.858504 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 487/968] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:17:57 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1757 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:17:58.865779 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-f9eb2a6b-3217-4871-a507-d201e60689a0 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:17:58.866449 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-f9eb2a6b-3217-4871-a507-d201e60689a0 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 552a9dd3-f749-4a67-afdb-1d4a206c7046] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:17:58.873627 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f9eb2a6b-3217-4871-a507-d201e60689a0 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:58.874116 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f9eb2a6b-3217-4871-a507-d201e60689a0 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:58.874892 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f9eb2a6b-3217-4871-a507-d201e60689a0 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:58.875329 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f9eb2a6b-3217-4871-a507-d201e60689a0 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:58.879129 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-2f82b78c-3813-4052-bbe3-df2f0b1276d9 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:17:58.879766 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-2f82b78c-3813-4052-bbe3-df2f0b1276d9 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:17:58.886634 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f82b78c-3813-4052-bbe3-df2f0b1276d9 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:58.887085 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f82b78c-3813-4052-bbe3-df2f0b1276d9 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:58.887855 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f82b78c-3813-4052-bbe3-df2f0b1276d9 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:17:58.888291 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-2f82b78c-3813-4052-bbe3-df2f0b1276d9 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:17:59.067851 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-f9eb2a6b-3217-4871-a507-d201e60689a0 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:17:59.076300 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-f9eb2a6b-3217-4871-a507-d201e60689a0 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046" status: 200 len: 1265 microversion: 2.1 time: 0.216046 Jun 25 16:17:59.076993 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 482/969] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:17:58 2022] GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046 => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:17:59.096866 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-2f82b78c-3813-4052-bbe3-df2f0b1276d9 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:17:59.105134 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-2f82b78c-3813-4052-bbe3-df2f0b1276d9 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1757 microversion: 2.1 time: 0.229796 Jun 25 16:17:59.105697 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 488/970] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:17:58 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1757 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:18:00.096687 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-a2547ad6-60da-4938-932c-7da362fa3a33 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:18:00.097652 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-a2547ad6-60da-4938-932c-7da362fa3a33 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 552a9dd3-f749-4a67-afdb-1d4a206c7046] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:18:00.105178 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a2547ad6-60da-4938-932c-7da362fa3a33 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:00.105641 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a2547ad6-60da-4938-932c-7da362fa3a33 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:00.106418 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a2547ad6-60da-4938-932c-7da362fa3a33 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:00.106865 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-a2547ad6-60da-4938-932c-7da362fa3a33 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:00.126324 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3bb4b141-9318-4522-9875-a7c455f07daa tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:18:00.126839 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3bb4b141-9318-4522-9875-a7c455f07daa tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:18:00.134226 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3bb4b141-9318-4522-9875-a7c455f07daa tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:00.134719 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3bb4b141-9318-4522-9875-a7c455f07daa tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:00.135514 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3bb4b141-9318-4522-9875-a7c455f07daa tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:00.135943 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3bb4b141-9318-4522-9875-a7c455f07daa tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:00.321432 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-a2547ad6-60da-4938-932c-7da362fa3a33 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:18:00.329308 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-a2547ad6-60da-4938-932c-7da362fa3a33 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046" status: 200 len: 1265 microversion: 2.1 time: 0.239091 Jun 25 16:18:00.329886 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 483/971] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:18:00 2022] GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046 => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:18:00.336504 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3bb4b141-9318-4522-9875-a7c455f07daa tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:18:00.344699 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3bb4b141-9318-4522-9875-a7c455f07daa tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1760 microversion: 2.1 time: 0.222310 Jun 25 16:18:00.345266 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 489/972] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:18:00 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1760 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:18:01.351636 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-3526a288-6d4e-4e5d-a27f-a464fc4e58d9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:18:01.352707 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-3526a288-6d4e-4e5d-a27f-a464fc4e58d9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 552a9dd3-f749-4a67-afdb-1d4a206c7046] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:18:01.363694 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3526a288-6d4e-4e5d-a27f-a464fc4e58d9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:01.364585 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3526a288-6d4e-4e5d-a27f-a464fc4e58d9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:01.366215 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3526a288-6d4e-4e5d-a27f-a464fc4e58d9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:01.366670 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-3526a288-6d4e-4e5d-a27f-a464fc4e58d9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:01.502462 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-3526a288-6d4e-4e5d-a27f-a464fc4e58d9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:18:01.510654 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-3526a288-6d4e-4e5d-a27f-a464fc4e58d9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046" status: 200 len: 1265 microversion: 2.1 time: 0.166404 Jun 25 16:18:01.511231 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 484/973] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:18:01 2022] GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:18:02.531264 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-88433033-5286-435a-9a2c-7aa8a56ffe78 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:18:02.532234 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-88433033-5286-435a-9a2c-7aa8a56ffe78 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 552a9dd3-f749-4a67-afdb-1d4a206c7046] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:18:02.535997 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=2 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:18:02.542418 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-88433033-5286-435a-9a2c-7aa8a56ffe78 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:02.542893 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-88433033-5286-435a-9a2c-7aa8a56ffe78 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:02.543662 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-88433033-5286-435a-9a2c-7aa8a56ffe78 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:02.544097 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-88433033-5286-435a-9a2c-7aa8a56ffe78 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:02.575518 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell0:SELECT=8 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:18:02.678120 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-88433033-5286-435a-9a2c-7aa8a56ffe78 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:18:02.685936 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-88433033-5286-435a-9a2c-7aa8a56ffe78 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046" status: 200 len: 1265 microversion: 2.1 time: 0.160815 Jun 25 16:18:02.686509 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 490/974] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:18:02 2022] GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:18:03.702954 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-d17ec94f-fd93-4ae1-af77-d67a48e838a9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:18:03.703566 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-d17ec94f-fd93-4ae1-af77-d67a48e838a9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 552a9dd3-f749-4a67-afdb-1d4a206c7046] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:18:03.711926 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d17ec94f-fd93-4ae1-af77-d67a48e838a9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:03.712674 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d17ec94f-fd93-4ae1-af77-d67a48e838a9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:03.713906 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d17ec94f-fd93-4ae1-af77-d67a48e838a9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:03.714428 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-d17ec94f-fd93-4ae1-af77-d67a48e838a9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:03.855000 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-d17ec94f-fd93-4ae1-af77-d67a48e838a9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:18:03.862870 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-d17ec94f-fd93-4ae1-af77-d67a48e838a9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046" status: 200 len: 1265 microversion: 2.1 time: 0.163981 Jun 25 16:18:03.863448 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 485/975] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:18:03 2022] GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:18:04.879988 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-3377cd9b-8191-4669-8653-95abe6fad960 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:18:04.880827 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-3377cd9b-8191-4669-8653-95abe6fad960 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 552a9dd3-f749-4a67-afdb-1d4a206c7046] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:18:04.888283 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3377cd9b-8191-4669-8653-95abe6fad960 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:04.889083 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3377cd9b-8191-4669-8653-95abe6fad960 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:04.889854 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3377cd9b-8191-4669-8653-95abe6fad960 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:04.890292 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-3377cd9b-8191-4669-8653-95abe6fad960 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:05.027133 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-3377cd9b-8191-4669-8653-95abe6fad960 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:18:05.039305 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-3377cd9b-8191-4669-8653-95abe6fad960 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046" status: 200 len: 1265 microversion: 2.1 time: 0.163069 Jun 25 16:18:05.040157 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 491/976] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:18:04 2022] GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:18:05.396271 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-35ed3383-0a62-4212-bd82-f7ce372c7792 req-6fa4d722-f95e-456c-88a7-a44f8ba1efec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "552a9dd3-f749-4a67-afdb-1d4a206c7046", "name": "network-vif-plugged", "status": "completed", "tag": "107462c9-7523-4740-bf19-c9c6fec3b93d"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:18:05.406748 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-35ed3383-0a62-4212-bd82-f7ce372c7792 req-6fa4d722-f95e-456c-88a7-a44f8ba1efec service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:05.407304 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-35ed3383-0a62-4212-bd82-f7ce372c7792 req-6fa4d722-f95e-456c-88a7-a44f8ba1efec service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:05.420018 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-35ed3383-0a62-4212-bd82-f7ce372c7792 req-6fa4d722-f95e-456c-88a7-a44f8ba1efec service nova] Creating event network-vif-plugged:107462c9-7523-4740-bf19-c9c6fec3b93d for instance 552a9dd3-f749-4a67-afdb-1d4a206c7046 on hv-cinder-84762 Jun 25 16:18:05.425070 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-35ed3383-0a62-4212-bd82-f7ce372c7792 req-6fa4d722-f95e-456c-88a7-a44f8ba1efec service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095473 Jun 25 16:18:05.425575 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 486/977] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:18:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:18:06.065753 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6e59712f-773a-4290-b5a6-0ba6e1665af2 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:18:06.066610 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6e59712f-773a-4290-b5a6-0ba6e1665af2 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 552a9dd3-f749-4a67-afdb-1d4a206c7046] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:18:06.073946 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6e59712f-773a-4290-b5a6-0ba6e1665af2 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:06.074402 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6e59712f-773a-4290-b5a6-0ba6e1665af2 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:06.075171 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6e59712f-773a-4290-b5a6-0ba6e1665af2 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:06.075605 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6e59712f-773a-4290-b5a6-0ba6e1665af2 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:06.215702 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6e59712f-773a-4290-b5a6-0ba6e1665af2 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:18:06.223360 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6e59712f-773a-4290-b5a6-0ba6e1665af2 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046" status: 200 len: 1265 microversion: 2.1 time: 0.164360 Jun 25 16:18:06.224063 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 492/978] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:18:06 2022] GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:18:07.245168 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-f38a90dd-1ad5-4f95-9eb8-001ee25f56ef tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:18:07.245971 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-f38a90dd-1ad5-4f95-9eb8-001ee25f56ef tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 552a9dd3-f749-4a67-afdb-1d4a206c7046] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:18:07.253333 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f38a90dd-1ad5-4f95-9eb8-001ee25f56ef tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:07.253832 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f38a90dd-1ad5-4f95-9eb8-001ee25f56ef tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:07.254681 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f38a90dd-1ad5-4f95-9eb8-001ee25f56ef tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:07.255165 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-f38a90dd-1ad5-4f95-9eb8-001ee25f56ef tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:07.393310 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-f38a90dd-1ad5-4f95-9eb8-001ee25f56ef tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:18:07.401562 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-f38a90dd-1ad5-4f95-9eb8-001ee25f56ef tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046" status: 200 len: 1452 microversion: 2.1 time: 0.162719 Jun 25 16:18:07.402131 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 487/979] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:18:07 2022] GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:18:07.417611 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-0d2812a3-c1aa-48bb-93cf-b45d56c499ee tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:18:07.418217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-0d2812a3-c1aa-48bb-93cf-b45d56c499ee tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 552a9dd3-f749-4a67-afdb-1d4a206c7046] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:18:07.425091 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0d2812a3-c1aa-48bb-93cf-b45d56c499ee tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:07.425537 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0d2812a3-c1aa-48bb-93cf-b45d56c499ee tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:07.426298 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0d2812a3-c1aa-48bb-93cf-b45d56c499ee tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:07.426731 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-0d2812a3-c1aa-48bb-93cf-b45d56c499ee tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:07.567295 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-0d2812a3-c1aa-48bb-93cf-b45d56c499ee tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:18:07.575534 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-0d2812a3-c1aa-48bb-93cf-b45d56c499ee tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046" status: 200 len: 1452 microversion: 2.1 time: 0.161779 Jun 25 16:18:07.576138 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 493/980] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:18:07 2022] GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:18:09.297077 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-326db48c-dc75-412d-a0f2-44c0314ff5f2 req-b19174e3-753d-4a87-a7da-4dd349164bf1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "552a9dd3-f749-4a67-afdb-1d4a206c7046", "tag": "107462c9-7523-4740-bf19-c9c6fec3b93d"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:18:09.305737 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-326db48c-dc75-412d-a0f2-44c0314ff5f2 req-b19174e3-753d-4a87-a7da-4dd349164bf1 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:09.306187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-326db48c-dc75-412d-a0f2-44c0314ff5f2 req-b19174e3-753d-4a87-a7da-4dd349164bf1 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:09.317169 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-326db48c-dc75-412d-a0f2-44c0314ff5f2 req-b19174e3-753d-4a87-a7da-4dd349164bf1 service nova] Creating event network-changed:107462c9-7523-4740-bf19-c9c6fec3b93d for instance 552a9dd3-f749-4a67-afdb-1d4a206c7046 on hv-cinder-84762 Jun 25 16:18:09.322623 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-326db48c-dc75-412d-a0f2-44c0314ff5f2 req-b19174e3-753d-4a87-a7da-4dd349164bf1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029171 Jun 25 16:18:09.323394 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 488/981] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:18:33.294792 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8b30f726-886f-4db9-a5c5-25aeb2d3af46 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1380889855"}} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:18:33.295568 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8b30f726-886f-4db9-a5c5-25aeb2d3af46 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:18:33.298629 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:18:33.299423 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=82 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:18:33.306409 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8b30f726-886f-4db9-a5c5-25aeb2d3af46 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:33.306958 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8b30f726-886f-4db9-a5c5-25aeb2d3af46 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:33.307903 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8b30f726-886f-4db9-a5c5-25aeb2d3af46 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:33.308449 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8b30f726-886f-4db9-a5c5-25aeb2d3af46 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:33.444503 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.network.security_group_api [None req-8b30f726-886f-4db9-a5c5-25aeb2d3af46 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Removing security group c4e1adc0-200b-47ae-bd2c-ec1bddadbcaa from port a95cf970-c715-4dd2-84f4-761293704f29 Jun 25 16:18:33.821243 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8b30f726-886f-4db9-a5c5-25aeb2d3af46 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "POST /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b/action" status: 202 len: 0 microversion: 2.1 time: 0.531372 Jun 25 16:18:33.822164 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 494/982] 10.222.0.13 () {60 vars in 1277 bytes} [Sat Jun 25 16:18:33 2022] POST /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b/action => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 16:18:33.838683 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-1261f47d-d969-42ae-9f46-fe5a63af5d78 req-45bea8a3-1a23-4604-81e3-b939ac1e0d94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3466d47-427c-4fde-9c19-90aea43be44b", "tag": "a95cf970-c715-4dd2-84f4-761293704f29"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:18:33.846388 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_api:SELECT=32 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:18:33.849193 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:18:33.856906 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-1261f47d-d969-42ae-9f46-fe5a63af5d78 req-45bea8a3-1a23-4604-81e3-b939ac1e0d94 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:33.857720 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-1261f47d-d969-42ae-9f46-fe5a63af5d78 req-45bea8a3-1a23-4604-81e3-b939ac1e0d94 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:33.877184 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-1261f47d-d969-42ae-9f46-fe5a63af5d78 req-45bea8a3-1a23-4604-81e3-b939ac1e0d94 service nova] Creating event network-changed:a95cf970-c715-4dd2-84f4-761293704f29 for instance a3466d47-427c-4fde-9c19-90aea43be44b on hv-cinder-84762 Jun 25 16:18:33.883631 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-1261f47d-d969-42ae-9f46-fe5a63af5d78 req-45bea8a3-1a23-4604-81e3-b939ac1e0d94 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049244 Jun 25 16:18:33.886078 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 489/983] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:18:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:18:35.396065 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-b7011b64-0bb5-49f4-aec2-023da8f00f76 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:18:35.396662 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-b7011b64-0bb5-49f4-aec2-023da8f00f76 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:18:35.402917 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b7011b64-0bb5-49f4-aec2-023da8f00f76 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:35.403381 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b7011b64-0bb5-49f4-aec2-023da8f00f76 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:35.404129 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b7011b64-0bb5-49f4-aec2-023da8f00f76 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:35.404589 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-b7011b64-0bb5-49f4-aec2-023da8f00f76 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:35.483997 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-b7011b64-0bb5-49f4-aec2-023da8f00f76 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lazy-loading 'services' on Instance uuid a3466d47-427c-4fde-9c19-90aea43be44b {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 16:18:35.557297 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-b7011b64-0bb5-49f4-aec2-023da8f00f76 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b/os-volume_attachments/8d6b5e9e-026d-47a9-abcd-53d64c501e61" status: 202 len: 0 microversion: 2.1 time: 0.165598 Jun 25 16:18:35.557899 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 495/984] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Jun 25 16:18:35 2022] DELETE /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b/os-volume_attachments/8d6b5e9e-026d-47a9-abcd-53d64c501e61 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 16:18:35.567717 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-23235353-54ac-4440-9992-4208ac5fd4df tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:18:35.568813 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-23235353-54ac-4440-9992-4208ac5fd4df tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:18:35.575591 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-23235353-54ac-4440-9992-4208ac5fd4df tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:35.576046 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-23235353-54ac-4440-9992-4208ac5fd4df tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:35.576923 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-23235353-54ac-4440-9992-4208ac5fd4df tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:35.577284 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-23235353-54ac-4440-9992-4208ac5fd4df tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:35.606944 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-23235353-54ac-4440-9992-4208ac5fd4df tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044337 Jun 25 16:18:35.608482 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 490/985] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Jun 25 16:18:35 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:18:35.915547 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-80dfb640-d63d-457e-847f-c6f1efd0c281 req-580dad36-b709-48fc-8f4f-bd1a4cffa132 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3466d47-427c-4fde-9c19-90aea43be44b", "tag": "a95cf970-c715-4dd2-84f4-761293704f29"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:18:35.924319 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-80dfb640-d63d-457e-847f-c6f1efd0c281 req-580dad36-b709-48fc-8f4f-bd1a4cffa132 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:35.924800 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-80dfb640-d63d-457e-847f-c6f1efd0c281 req-580dad36-b709-48fc-8f4f-bd1a4cffa132 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:35.936240 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-80dfb640-d63d-457e-847f-c6f1efd0c281 req-580dad36-b709-48fc-8f4f-bd1a4cffa132 service nova] Creating event network-changed:a95cf970-c715-4dd2-84f4-761293704f29 for instance a3466d47-427c-4fde-9c19-90aea43be44b on hv-cinder-84762 Jun 25 16:18:35.941290 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-80dfb640-d63d-457e-847f-c6f1efd0c281 req-580dad36-b709-48fc-8f4f-bd1a4cffa132 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029996 Jun 25 16:18:35.941845 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 496/986] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:18:36.619531 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-954779e2-46c9-478f-b771-ee16f2536133 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:18:36.620363 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-954779e2-46c9-478f-b771-ee16f2536133 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:18:36.627250 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-954779e2-46c9-478f-b771-ee16f2536133 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:36.627696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-954779e2-46c9-478f-b771-ee16f2536133 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:36.628510 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-954779e2-46c9-478f-b771-ee16f2536133 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:36.628981 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-954779e2-46c9-478f-b771-ee16f2536133 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:36.658224 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-954779e2-46c9-478f-b771-ee16f2536133 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042841 Jun 25 16:18:36.658756 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 491/987] 10.222.0.13 () {58 vars in 1301 bytes} [Sat Jun 25 16:18:36 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 25 16:18:36.670784 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9ef60f86-ff4f-4e63-9abb-2ea1c8cebcbc tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:18:36.671334 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-9ef60f86-ff4f-4e63-9abb-2ea1c8cebcbc tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:18:36.678034 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9ef60f86-ff4f-4e63-9abb-2ea1c8cebcbc tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:36.678526 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9ef60f86-ff4f-4e63-9abb-2ea1c8cebcbc tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:36.679412 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9ef60f86-ff4f-4e63-9abb-2ea1c8cebcbc tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:36.679944 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-9ef60f86-ff4f-4e63-9abb-2ea1c8cebcbc tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:36.757312 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-9ef60f86-ff4f-4e63-9abb-2ea1c8cebcbc tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] HTTP exception thrown: Instance a3466d47-427c-4fde-9c19-90aea43be44b is not attached to volume 8d6b5e9e-026d-47a9-abcd-53d64c501e61 Jun 25 16:18:36.759696 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9ef60f86-ff4f-4e63-9abb-2ea1c8cebcbc tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Request method failure captured: Jun 25 16:18:36.759696 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: request: DELETE /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b/os-volume_attachments/8d6b5e9e-026d-47a9-abcd-53d64c501e61 HTTP/1.1 Jun 25 16:18:36.759696 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept: application/json Jun 25 16:18:36.759696 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jun 25 16:18:36.759696 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Connection: close Jun 25 16:18:36.759696 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jun 25 16:18:36.759696 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jun 25 16:18:36.759696 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Host: 10.222.0.13 Jun 25 16:18:36.759696 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jun 25 16:18:36.759696 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jun 25 16:18:36.759696 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABitzTkGJjVQDNZme1r6--O4ZH48AF2kOamHbYE2yfaFQuUd81u-WcaNT_zTlxROE6u6t4blgcQYK0x_vieXLX45yjuc8P73jxdein0VrgHlna1OfO_HCZezHCv5pXAqOxaL-kR2Klq1aXquzB4PYdiBhW4mkYfSyAz8k3jjZ83g4HhLW0 Jun 25 16:18:36.759696 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jun 25 16:18:36.759696 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jun 25 16:18:36.759696 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jun 25 16:18:36.759696 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jun 25 16:18:36.759696 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jun 25 16:18:36.759696 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jun 25 16:18:36.759696 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Id: b1730bdd7de14144bf75c92004923f9a Jun 25 16:18:36.759696 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-TestMinimumBasicScenario-1764023687 Jun 25 16:18:36.759696 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Role: reader,member Jun 25 16:18:36.759696 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Jun 25 16:18:36.761453 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b1730bdd7de14144bf75c92004923f9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b1730bdd7de14144bf75c92004923f9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b1730bdd7de14144bf75c92004923f9a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b1730bdd7de14144bf75c92004923f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:18:36.761453 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-TestMinimumBasicScenario-1764023687 Jun 25 16:18:36.761453 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Id: b1730bdd7de14144bf75c92004923f9a Jun 25 16:18:36.761453 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1764023687 Jun 25 16:18:36.761453 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User: tempest-TestMinimumBasicScenario-1764023687-project Jun 25 16:18:36.761453 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jun 25 16:18:36.761453 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jun 25 16:18:36.761453 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Id: c7b128ef63b94a71b7377a08aae7990f Jun 25 16:18:36.761453 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-TestMinimumBasicScenario-1764023687-project Jun 25 16:18:36.761453 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: method: > Jun 25 16:18:36.761453 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: exception: Instance a3466d47-427c-4fde-9c19-90aea43be44b is not attached to volume 8d6b5e9e-026d-47a9-abcd-53d64c501e61 Jun 25 16:18:36.762394 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: action_args: {'server_id': 'a3466d47-427c-4fde-9c19-90aea43be44b', 'id': '8d6b5e9e-026d-47a9-abcd-53d64c501e61'} Jun 25 16:18:36.762394 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:18:36.762394 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:18:36.762394 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 25 16:18:36.762394 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 25 16:18:36.762394 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 25 16:18:36.762394 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 25 16:18:36.762394 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 25 16:18:36.762394 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 25 16:18:36.762394 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8d6b5e9e-026d-47a9-abcd-53d64c501e61. Jun 25 16:18:36.762394 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:18:36.762394 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:18:36.762394 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:18:36.762394 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:18:36.762394 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:18:36.762394 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:18:36.762394 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:18:36.762394 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:18:36.762394 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:18:36.764233 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:18:36.764233 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 25 16:18:36.764233 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 25 16:18:36.764233 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3466d47-427c-4fde-9c19-90aea43be44b is not attached to volume 8d6b5e9e-026d-47a9-abcd-53d64c501e61 Jun 25 16:18:36.764233 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:18:36.764233 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:18:36.764233 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:18:36.764233 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:18:36.764233 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:18:36.764233 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:18:36.764233 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:18:36.764233 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:18:36.764233 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3466d47-427c-4fde-9c19-90aea43be44b is not attached to volume 8d6b5e9e-026d-47a9-abcd-53d64c501e61 Jun 25 16:18:36.764233 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:18:36.764233 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-9ef60f86-ff4f-4e63-9abb-2ea1c8cebcbc tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Returning 404 to user: Instance a3466d47-427c-4fde-9c19-90aea43be44b is not attached to volume 8d6b5e9e-026d-47a9-abcd-53d64c501e61 {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:18:36.765468 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-9ef60f86-ff4f-4e63-9abb-2ea1c8cebcbc tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b/os-volume_attachments/8d6b5e9e-026d-47a9-abcd-53d64c501e61" status: 404 len: 154 microversion: 2.1 time: 0.095452 Jun 25 16:18:36.765468 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 497/988] 10.222.0.13 () {58 vars in 1415 bytes} [Sat Jun 25 16:18:36 2022] DELETE /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b/os-volume_attachments/8d6b5e9e-026d-47a9-abcd-53d64c501e61 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:18:37.912236 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-e97fab8f-294c-417b-b7f5-514fefe86588 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:18:37.912841 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-e97fab8f-294c-417b-b7f5-514fefe86588 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:18:37.922993 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e97fab8f-294c-417b-b7f5-514fefe86588 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:37.923621 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e97fab8f-294c-417b-b7f5-514fefe86588 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:37.924864 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e97fab8f-294c-417b-b7f5-514fefe86588 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:37.925501 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-e97fab8f-294c-417b-b7f5-514fefe86588 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:37.952437 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-e97fab8f-294c-417b-b7f5-514fefe86588 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Going to try to terminate instance {{(pid=117794) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 16:18:38.035585 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-e97fab8f-294c-417b-b7f5-514fefe86588 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 204 len: 0 microversion: 2.1 time: 0.128857 Jun 25 16:18:38.036202 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 492/989] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Jun 25 16:18:37 2022] DELETE /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 16:18:38.044725 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-6875f4e9-939c-4bd7-824b-19eaa573bc21 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:18:38.045359 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-6875f4e9-939c-4bd7-824b-19eaa573bc21 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:18:38.052550 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6875f4e9-939c-4bd7-824b-19eaa573bc21 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:38.053052 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6875f4e9-939c-4bd7-824b-19eaa573bc21 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:38.053819 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6875f4e9-939c-4bd7-824b-19eaa573bc21 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:38.054253 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-6875f4e9-939c-4bd7-824b-19eaa573bc21 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:38.194495 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-6875f4e9-939c-4bd7-824b-19eaa573bc21 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:18:38.202385 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-6875f4e9-939c-4bd7-824b-19eaa573bc21 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1554 microversion: 2.1 time: 0.161594 Jun 25 16:18:38.202960 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 498/990] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:18:38 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:18:39.228798 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-715f5d1d-223b-46c9-885c-0e28a41b60df tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:18:39.229938 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-715f5d1d-223b-46c9-885c-0e28a41b60df tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:18:39.240894 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-715f5d1d-223b-46c9-885c-0e28a41b60df tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:39.241673 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-715f5d1d-223b-46c9-885c-0e28a41b60df tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:39.242888 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-715f5d1d-223b-46c9-885c-0e28a41b60df tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:39.243613 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-715f5d1d-223b-46c9-885c-0e28a41b60df tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:39.384796 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-715f5d1d-223b-46c9-885c-0e28a41b60df tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:18:39.393321 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-715f5d1d-223b-46c9-885c-0e28a41b60df tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1554 microversion: 2.1 time: 0.171637 Jun 25 16:18:39.393838 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 493/991] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:18:39 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:18:40.143589 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [req-9e685802-09b1-43b8-b80d-25e7065c2ac0 req-3b7bf317-06ae-4c59-9955-716fac29769b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3466d47-427c-4fde-9c19-90aea43be44b", "name": "network-vif-deleted", "tag": "a95cf970-c715-4dd2-84f4-761293704f29"}]} {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:18:40.152698 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-9e685802-09b1-43b8-b80d-25e7065c2ac0 req-3b7bf317-06ae-4c59-9955-716fac29769b service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:40.153139 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [req-9e685802-09b1-43b8-b80d-25e7065c2ac0 req-3b7bf317-06ae-4c59-9955-716fac29769b service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:40.164792 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.compute.server_external_events [req-9e685802-09b1-43b8-b80d-25e7065c2ac0 req-3b7bf317-06ae-4c59-9955-716fac29769b service nova] Creating event network-vif-deleted:a95cf970-c715-4dd2-84f4-761293704f29 for instance a3466d47-427c-4fde-9c19-90aea43be44b on hv-cinder-84762 Jun 25 16:18:40.169866 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [req-9e685802-09b1-43b8-b80d-25e7065c2ac0 req-3b7bf317-06ae-4c59-9955-716fac29769b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029872 Jun 25 16:18:40.170456 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 499/992] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:18:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:18:40.413919 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-71dcb51b-04e5-4a29-9ea5-e5e6be393ad1 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:18:40.415037 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-71dcb51b-04e5-4a29-9ea5-e5e6be393ad1 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:18:40.424917 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-71dcb51b-04e5-4a29-9ea5-e5e6be393ad1 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:40.425615 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-71dcb51b-04e5-4a29-9ea5-e5e6be393ad1 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:40.427019 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-71dcb51b-04e5-4a29-9ea5-e5e6be393ad1 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:40.427458 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-71dcb51b-04e5-4a29-9ea5-e5e6be393ad1 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:40.460256 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-71dcb51b-04e5-4a29-9ea5-e5e6be393ad1 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:40.460705 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-71dcb51b-04e5-4a29-9ea5-e5e6be393ad1 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:40.461184 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.objects.instance [None req-71dcb51b-04e5-4a29-9ea5-e5e6be393ad1 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lazy-loading 'fault' on Instance uuid a3466d47-427c-4fde-9c19-90aea43be44b {{(pid=117794) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 16:18:40.508335 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-71dcb51b-04e5-4a29-9ea5-e5e6be393ad1 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7b128ef63b94a71b7377a08aae7990f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b1730bdd7de14144bf75c92004923f9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:18:40.519114 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-71dcb51b-04e5-4a29-9ea5-e5e6be393ad1 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 200 len: 1349 microversion: 2.1 time: 0.110632 Jun 25 16:18:40.520363 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 494/993] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:18:40 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 1349 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:18:41.543143 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4637b123-a6b7-49e1-ad61-a99a40dbff70 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:18:41.544285 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-4637b123-a6b7-49e1-ad61-a99a40dbff70 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] [instance: a3466d47-427c-4fde-9c19-90aea43be44b] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:18:41.555200 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4637b123-a6b7-49e1-ad61-a99a40dbff70 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:41.555937 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4637b123-a6b7-49e1-ad61-a99a40dbff70 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:41.557608 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4637b123-a6b7-49e1-ad61-a99a40dbff70 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:18:41.557962 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-4637b123-a6b7-49e1-ad61-a99a40dbff70 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:18:41.576432 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-4637b123-a6b7-49e1-ad61-a99a40dbff70 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] HTTP exception thrown: Instance a3466d47-427c-4fde-9c19-90aea43be44b could not be found. Jun 25 16:18:41.578109 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4637b123-a6b7-49e1-ad61-a99a40dbff70 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Request method failure captured: Jun 25 16:18:41.578109 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: request: GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b HTTP/1.1 Jun 25 16:18:41.578109 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept: application/json Jun 25 16:18:41.578109 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jun 25 16:18:41.578109 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Connection: close Jun 25 16:18:41.578109 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jun 25 16:18:41.578109 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jun 25 16:18:41.578109 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Host: 10.222.0.13 Jun 25 16:18:41.578109 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jun 25 16:18:41.578109 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jun 25 16:18:41.578109 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABitzTkGJjVQDNZme1r6--O4ZH48AF2kOamHbYE2yfaFQuUd81u-WcaNT_zTlxROE6u6t4blgcQYK0x_vieXLX45yjuc8P73jxdein0VrgHlna1OfO_HCZezHCv5pXAqOxaL-kR2Klq1aXquzB4PYdiBhW4mkYfSyAz8k3jjZ83g4HhLW0 Jun 25 16:18:41.578109 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jun 25 16:18:41.578109 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jun 25 16:18:41.578109 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jun 25 16:18:41.578109 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jun 25 16:18:41.578109 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jun 25 16:18:41.578109 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jun 25 16:18:41.578109 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Id: b1730bdd7de14144bf75c92004923f9a Jun 25 16:18:41.578109 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-TestMinimumBasicScenario-1764023687 Jun 25 16:18:41.578109 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Role: reader,member Jun 25 16:18:41.578109 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Jun 25 16:18:41.579528 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b1730bdd7de14144bf75c92004923f9a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b1730bdd7de14144bf75c92004923f9a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b1730bdd7de14144bf75c92004923f9a", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b1730bdd7de14144bf75c92004923f9a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:18:41.579528 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-TestMinimumBasicScenario-1764023687 Jun 25 16:18:41.579528 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Id: b1730bdd7de14144bf75c92004923f9a Jun 25 16:18:41.579528 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1764023687 Jun 25 16:18:41.579528 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User: tempest-TestMinimumBasicScenario-1764023687-project Jun 25 16:18:41.579528 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jun 25 16:18:41.579528 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jun 25 16:18:41.579528 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Id: c7b128ef63b94a71b7377a08aae7990f Jun 25 16:18:41.579528 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-TestMinimumBasicScenario-1764023687-project Jun 25 16:18:41.579528 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: method: > Jun 25 16:18:41.579528 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: exception: Instance a3466d47-427c-4fde-9c19-90aea43be44b could not be found. Jun 25 16:18:41.579528 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: action_args: {'id': 'a3466d47-427c-4fde-9c19-90aea43be44b'} Jun 25 16:18:41.580544 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:18:41.580544 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:18:41.580544 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:18:41.580544 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:18:41.580544 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:18:41.580544 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:18:41.580544 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:18:41.580544 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:18:41.580544 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:18:41.580544 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:18:41.580544 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3466d47-427c-4fde-9c19-90aea43be44b could not be found. Jun 25 16:18:41.580544 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:18:41.580544 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:18:41.580544 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:18:41.580544 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:18:41.580544 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:18:41.580544 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:18:41.580544 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:18:41.580544 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:18:41.580544 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:18:41.582217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:18:41.582217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 16:18:41.582217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 16:18:41.582217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:18:41.582217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:18:41.582217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:18:41.582217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:18:41.582217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3466d47-427c-4fde-9c19-90aea43be44b could not be found. Jun 25 16:18:41.582217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:18:41.582217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:18:41.582217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:18:41.582217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:18:41.582217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:18:41.582217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:18:41.582217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:18:41.582217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:18:41.582217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3466d47-427c-4fde-9c19-90aea43be44b could not be found. Jun 25 16:18:41.582217 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:18:41.583776 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-4637b123-a6b7-49e1-ad61-a99a40dbff70 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Returning 404 to user: Instance a3466d47-427c-4fde-9c19-90aea43be44b could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:18:41.583776 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-4637b123-a6b7-49e1-ad61-a99a40dbff70 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b" status: 404 len: 111 microversion: 2.1 time: 0.044267 Jun 25 16:18:41.583776 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 500/994] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:18:41 2022] GET /compute/v2.1/servers/a3466d47-427c-4fde-9c19-90aea43be44b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:18:41.589140 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-bb7a321d-3f73-4375-8698-830569ae2177 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] Calling method '.version_select at 0x7f65bb5aa310>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:18:41.612534 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-bb7a321d-3f73-4375-8698-830569ae2177 tempest-TestMinimumBasicScenario-1764023687 tempest-TestMinimumBasicScenario-1764023687-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1770596430" status: 202 len: 0 microversion: 2.1 time: 0.027289 Jun 25 16:18:41.613116 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 495/995] 10.222.0.13 () {58 vars in 1271 bytes} [Sat Jun 25 16:18:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1770596430 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 16:19:49.775844 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:19:49.776569 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-681465b4-732c-45cf-a3c6-bc4f2e92a96e tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:19:49.776569 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-681465b4-732c-45cf-a3c6-bc4f2e92a96e tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 552a9dd3-f749-4a67-afdb-1d4a206c7046] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:19:49.777168 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG dbcounter [-] [117794] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117794) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:19:49.779119 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_api:SELECT=14 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:19:49.779852 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG dbcounter [-] [117793] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=117793) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 25 16:19:49.781749 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-5dd11eb3-ae1b-4a99-b57d-ab765f22e962 req-60510874-6cf3-4616-b284-8751ec215fc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "552a9dd3-f749-4a67-afdb-1d4a206c7046", "tag": "107462c9-7523-4740-bf19-c9c6fec3b93d"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:19:49.786514 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-681465b4-732c-45cf-a3c6-bc4f2e92a96e tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:19:49.787055 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-681465b4-732c-45cf-a3c6-bc4f2e92a96e tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:19:49.787877 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-681465b4-732c-45cf-a3c6-bc4f2e92a96e tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:19:49.788448 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-681465b4-732c-45cf-a3c6-bc4f2e92a96e tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:19:49.795614 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-5dd11eb3-ae1b-4a99-b57d-ab765f22e962 req-60510874-6cf3-4616-b284-8751ec215fc8 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:19:49.796051 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-5dd11eb3-ae1b-4a99-b57d-ab765f22e962 req-60510874-6cf3-4616-b284-8751ec215fc8 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:19:49.808325 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-5dd11eb3-ae1b-4a99-b57d-ab765f22e962 req-60510874-6cf3-4616-b284-8751ec215fc8 service nova] Creating event network-changed:107462c9-7523-4740-bf19-c9c6fec3b93d for instance 552a9dd3-f749-4a67-afdb-1d4a206c7046 on hv-cinder-84762 Jun 25 16:19:49.814135 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-5dd11eb3-ae1b-4a99-b57d-ab765f22e962 req-60510874-6cf3-4616-b284-8751ec215fc8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040040 Jun 25 16:19:49.818385 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 496/996] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:19:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:19:49.818870 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-681465b4-732c-45cf-a3c6-bc4f2e92a96e tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 552a9dd3-f749-4a67-afdb-1d4a206c7046] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 16:19:49.911630 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-681465b4-732c-45cf-a3c6-bc4f2e92a96e tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "DELETE /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046" status: 204 len: 0 microversion: 2.1 time: 0.139253 Jun 25 16:19:49.916976 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 501/997] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Jun 25 16:19:49 2022] DELETE /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 16:19:49.922051 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-84edc299-a941-4a07-80e0-000c25bba83d tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:19:49.922766 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-84edc299-a941-4a07-80e0-000c25bba83d tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 552a9dd3-f749-4a67-afdb-1d4a206c7046] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:19:49.929458 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-84edc299-a941-4a07-80e0-000c25bba83d tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:19:49.930185 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-84edc299-a941-4a07-80e0-000c25bba83d tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:19:49.931169 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-84edc299-a941-4a07-80e0-000c25bba83d tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:19:49.931850 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-84edc299-a941-4a07-80e0-000c25bba83d tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:19:50.083357 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-84edc299-a941-4a07-80e0-000c25bba83d tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:19:50.091260 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-84edc299-a941-4a07-80e0-000c25bba83d tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046" status: 200 len: 1577 microversion: 2.1 time: 0.173628 Jun 25 16:19:50.091935 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 497/998] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:19:49 2022] GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046 => generated 1577 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:19:51.109651 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-5cb38bff-b4da-41e8-a1e7-9172eb06a498 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:19:51.110299 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-5cb38bff-b4da-41e8-a1e7-9172eb06a498 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 552a9dd3-f749-4a67-afdb-1d4a206c7046] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:19:51.117283 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5cb38bff-b4da-41e8-a1e7-9172eb06a498 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:19:51.117732 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5cb38bff-b4da-41e8-a1e7-9172eb06a498 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:19:51.118497 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5cb38bff-b4da-41e8-a1e7-9172eb06a498 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:19:51.118923 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-5cb38bff-b4da-41e8-a1e7-9172eb06a498 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:19:51.298339 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-5cb38bff-b4da-41e8-a1e7-9172eb06a498 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:19:51.306390 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-5cb38bff-b4da-41e8-a1e7-9172eb06a498 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046" status: 200 len: 1577 microversion: 2.1 time: 0.201112 Jun 25 16:19:51.306953 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 502/999] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:19:51 2022] GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046 => generated 1577 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:19:51.897124 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-d6f90058-a2cd-4abc-ba0d-781e65afae04 req-7cf8bccc-1cc3-431e-aa63-6527141189f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "552a9dd3-f749-4a67-afdb-1d4a206c7046", "name": "network-vif-deleted", "tag": "107462c9-7523-4740-bf19-c9c6fec3b93d"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:19:51.905974 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-d6f90058-a2cd-4abc-ba0d-781e65afae04 req-7cf8bccc-1cc3-431e-aa63-6527141189f0 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:19:51.906417 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-d6f90058-a2cd-4abc-ba0d-781e65afae04 req-7cf8bccc-1cc3-431e-aa63-6527141189f0 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:19:51.917871 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-d6f90058-a2cd-4abc-ba0d-781e65afae04 req-7cf8bccc-1cc3-431e-aa63-6527141189f0 service nova] Creating event network-vif-deleted:107462c9-7523-4740-bf19-c9c6fec3b93d for instance 552a9dd3-f749-4a67-afdb-1d4a206c7046 on hv-cinder-84762 Jun 25 16:19:51.922739 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-d6f90058-a2cd-4abc-ba0d-781e65afae04 req-7cf8bccc-1cc3-431e-aa63-6527141189f0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029448 Jun 25 16:19:51.923321 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 498/1000] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:19:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:19:52.324572 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-91046df9-151f-4924-8c3c-57c40acecbf7 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:19:52.325267 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-91046df9-151f-4924-8c3c-57c40acecbf7 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 552a9dd3-f749-4a67-afdb-1d4a206c7046] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:19:52.331793 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91046df9-151f-4924-8c3c-57c40acecbf7 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:19:52.332347 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91046df9-151f-4924-8c3c-57c40acecbf7 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:19:52.333415 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91046df9-151f-4924-8c3c-57c40acecbf7 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:19:52.333917 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91046df9-151f-4924-8c3c-57c40acecbf7 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:19:52.364904 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91046df9-151f-4924-8c3c-57c40acecbf7 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:19:52.365342 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-91046df9-151f-4924-8c3c-57c40acecbf7 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:19:52.365755 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.objects.instance [None req-91046df9-151f-4924-8c3c-57c40acecbf7 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lazy-loading 'fault' on Instance uuid 552a9dd3-f749-4a67-afdb-1d4a206c7046 {{(pid=117793) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 25 16:19:52.407830 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-91046df9-151f-4924-8c3c-57c40acecbf7 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:19:52.415494 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-91046df9-151f-4924-8c3c-57c40acecbf7 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046" status: 200 len: 1229 microversion: 2.1 time: 0.095579 Jun 25 16:19:52.416001 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 503/1001] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:19:52 2022] GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046 => generated 1229 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:19:53.434989 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-60a38cdc-d073-4fd8-8d6a-39bead87e89c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:19:53.435815 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-60a38cdc-d073-4fd8-8d6a-39bead87e89c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 552a9dd3-f749-4a67-afdb-1d4a206c7046] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:19:53.443249 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-60a38cdc-d073-4fd8-8d6a-39bead87e89c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:19:53.443695 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-60a38cdc-d073-4fd8-8d6a-39bead87e89c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:19:53.444481 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-60a38cdc-d073-4fd8-8d6a-39bead87e89c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:19:53.444947 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-60a38cdc-d073-4fd8-8d6a-39bead87e89c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:19:53.459086 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.wsgi [None req-60a38cdc-d073-4fd8-8d6a-39bead87e89c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] HTTP exception thrown: Instance 552a9dd3-f749-4a67-afdb-1d4a206c7046 could not be found. Jun 25 16:19:53.460782 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-60a38cdc-d073-4fd8-8d6a-39bead87e89c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Request method failure captured: Jun 25 16:19:53.460782 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: request: GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046 HTTP/1.1 Jun 25 16:19:53.460782 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept: application/json Jun 25 16:19:53.460782 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept-Encoding: identity Jun 25 16:19:53.460782 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Connection: close Jun 25 16:19:53.460782 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Length: 0 Jun 25 16:19:53.460782 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Type: application/json Jun 25 16:19:53.460782 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Host: 10.222.0.13 Jun 25 16:19:53.460782 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Openstack-System-Scope: None Jun 25 16:19:53.460782 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: User-Agent: python-urllib3/1.26.9 Jun 25 16:19:53.460782 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Auth-Token: gAAAAABitzQb-xw95mjecey84BRjb_sUuTti5eEkBXvXkQMog8OEulHRzkQ55Yt_C-J3nkeMNJZWKrD6E7TkI2e1wqtLNkmM1pQxFbwGdu_pPimUhn1tuo1_zNrTPVSUQxqUL9j2ZrMXyaoX2LbVyOCGwF8jj877nxLXfggjnLUjUGa6alxlsdk Jun 25 16:19:53.460782 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Id: None Jun 25 16:19:53.460782 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Name: None Jun 25 16:19:53.460782 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Identity-Status: Confirmed Jun 25 16:19:53.460782 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Is-Admin-Project: True Jun 25 16:19:53.460782 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Id: default Jun 25 16:19:53.460782 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Name: Default Jun 25 16:19:53.460782 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Id: c5bb30b042f3422faf43af82b27b37a5 Jun 25 16:19:53.460782 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Name: tempest-TestVolumeBootPattern-647003375 Jun 25 16:19:53.460782 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Role: reader,member Jun 25 16:19:53.460782 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Roles: reader,member Jun 25 16:19:53.462625 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c5bb30b042f3422faf43af82b27b37a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c5bb30b042f3422faf43af82b27b37a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c5bb30b042f3422faf43af82b27b37a5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c5bb30b042f3422faf43af82b27b37a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:19:53.462625 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant: tempest-TestVolumeBootPattern-647003375 Jun 25 16:19:53.462625 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Id: c5bb30b042f3422faf43af82b27b37a5 Jun 25 16:19:53.462625 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Name: tempest-TestVolumeBootPattern-647003375 Jun 25 16:19:53.462625 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User: tempest-TestVolumeBootPattern-647003375-project Jun 25 16:19:53.462625 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Id: default Jun 25 16:19:53.462625 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Name: Default Jun 25 16:19:53.462625 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Id: 0ef599055aed42f3a97fb30bba553fb0 Jun 25 16:19:53.462625 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Name: tempest-TestVolumeBootPattern-647003375-project Jun 25 16:19:53.462625 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: method: > Jun 25 16:19:53.462625 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: exception: Instance 552a9dd3-f749-4a67-afdb-1d4a206c7046 could not be found. Jun 25 16:19:53.462625 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: action_args: {'id': '552a9dd3-f749-4a67-afdb-1d4a206c7046'} Jun 25 16:19:53.463696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:19:53.463696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:19:53.463696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:19:53.463696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:19:53.463696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:19:53.463696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:19:53.463696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:19:53.463696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:19:53.463696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:19:53.463696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:19:53.463696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 552a9dd3-f749-4a67-afdb-1d4a206c7046 could not be found. Jun 25 16:19:53.463696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:19:53.463696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:19:53.463696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:19:53.463696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:19:53.463696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:19:53.463696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:19:53.463696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:19:53.463696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:19:53.463696 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:19:53.465330 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:19:53.465330 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 16:19:53.465330 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 16:19:53.465330 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:19:53.465330 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:19:53.465330 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:19:53.465330 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:19:53.465330 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 552a9dd3-f749-4a67-afdb-1d4a206c7046 could not be found. Jun 25 16:19:53.465330 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:19:53.465330 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:19:53.465330 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:19:53.465330 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:19:53.465330 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:19:53.465330 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:19:53.465330 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:19:53.465330 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:19:53.465330 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 552a9dd3-f749-4a67-afdb-1d4a206c7046 could not be found. Jun 25 16:19:53.465330 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:19:53.466768 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-60a38cdc-d073-4fd8-8d6a-39bead87e89c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Returning 404 to user: Instance 552a9dd3-f749-4a67-afdb-1d4a206c7046 could not be found. {{(pid=117794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:19:53.466768 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-60a38cdc-d073-4fd8-8d6a-39bead87e89c tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046" status: 404 len: 111 microversion: 2.1 time: 0.032820 Jun 25 16:19:53.466768 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 499/1002] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:19:53 2022] GET /compute/v2.1/servers/552a9dd3-f749-4a67-afdb-1d4a206c7046 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:19:56.602762 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-04f4a336-fcb9-486f-b192-f34f371335bd tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:19:56.603309 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-04f4a336-fcb9-486f-b192-f34f371335bd tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 268b2363-bee8-4f04-a236-5b2a92fdd9d2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:19:56.603774 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-97f180ac-4576-41b0-87aa-80356c8955f8 req-de441652-c0ab-4307-bc1c-514f996582f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "268b2363-bee8-4f04-a236-5b2a92fdd9d2", "tag": "0c4c3de8-0099-4bf6-aba3-58227e338f77"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:19:56.610262 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-04f4a336-fcb9-486f-b192-f34f371335bd tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:19:56.610718 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-04f4a336-fcb9-486f-b192-f34f371335bd tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:19:56.611530 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-04f4a336-fcb9-486f-b192-f34f371335bd tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:19:56.611968 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-04f4a336-fcb9-486f-b192-f34f371335bd tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:19:56.613721 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-97f180ac-4576-41b0-87aa-80356c8955f8 req-de441652-c0ab-4307-bc1c-514f996582f2 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:19:56.614230 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-97f180ac-4576-41b0-87aa-80356c8955f8 req-de441652-c0ab-4307-bc1c-514f996582f2 service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:19:56.625924 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-97f180ac-4576-41b0-87aa-80356c8955f8 req-de441652-c0ab-4307-bc1c-514f996582f2 service nova] Creating event network-changed:0c4c3de8-0099-4bf6-aba3-58227e338f77 for instance 268b2363-bee8-4f04-a236-5b2a92fdd9d2 on hv-cinder-84762 Jun 25 16:19:56.632609 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-97f180ac-4576-41b0-87aa-80356c8955f8 req-de441652-c0ab-4307-bc1c-514f996582f2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032455 Jun 25 16:19:56.633268 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 500/1003] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:19:56.641668 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-04f4a336-fcb9-486f-b192-f34f371335bd tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 268b2363-bee8-4f04-a236-5b2a92fdd9d2] Going to try to terminate instance {{(pid=117793) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 25 16:19:56.736774 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-04f4a336-fcb9-486f-b192-f34f371335bd tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "DELETE /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2" status: 204 len: 0 microversion: 2.1 time: 0.137868 Jun 25 16:19:56.737453 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 504/1004] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Jun 25 16:19:56 2022] DELETE /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 25 16:19:56.747147 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-5b060dcc-b97a-4605-8a02-ea31a8e6f240 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:19:56.747854 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-5b060dcc-b97a-4605-8a02-ea31a8e6f240 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 268b2363-bee8-4f04-a236-5b2a92fdd9d2] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:19:56.754729 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5b060dcc-b97a-4605-8a02-ea31a8e6f240 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:19:56.755236 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5b060dcc-b97a-4605-8a02-ea31a8e6f240 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:19:56.756313 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5b060dcc-b97a-4605-8a02-ea31a8e6f240 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:19:56.756818 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-5b060dcc-b97a-4605-8a02-ea31a8e6f240 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:19:56.904206 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.policy [None req-5b060dcc-b97a-4605-8a02-ea31a8e6f240 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117794) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:19:56.908839 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-5b060dcc-b97a-4605-8a02-ea31a8e6f240 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2" status: 200 len: 1576 microversion: 2.1 time: 0.166537 Jun 25 16:19:56.909721 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 501/1005] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:19:56 2022] GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:19:57.927909 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-07d730e9-2c2f-4fea-aaf6-212dbdf860ce tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:19:57.928542 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-07d730e9-2c2f-4fea-aaf6-212dbdf860ce tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 268b2363-bee8-4f04-a236-5b2a92fdd9d2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:19:57.937061 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-07d730e9-2c2f-4fea-aaf6-212dbdf860ce tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:19:57.937674 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-07d730e9-2c2f-4fea-aaf6-212dbdf860ce tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:19:57.938837 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-07d730e9-2c2f-4fea-aaf6-212dbdf860ce tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:19:57.939470 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-07d730e9-2c2f-4fea-aaf6-212dbdf860ce tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:19:58.075876 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-07d730e9-2c2f-4fea-aaf6-212dbdf860ce tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:19:58.084009 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-07d730e9-2c2f-4fea-aaf6-212dbdf860ce tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2" status: 200 len: 1576 microversion: 2.1 time: 0.160592 Jun 25 16:19:58.084652 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 505/1006] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:19:57 2022] GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:19:58.915906 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [req-b900323b-a1f2-4c9e-9bf6-a60bcaffa4bb req-ff215967-d6ca-45ef-9ff6-178d10fd06ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "268b2363-bee8-4f04-a236-5b2a92fdd9d2", "name": "network-vif-deleted", "tag": "0c4c3de8-0099-4bf6-aba3-58227e338f77"}]} {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 25 16:19:58.924647 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-b900323b-a1f2-4c9e-9bf6-a60bcaffa4bb req-ff215967-d6ca-45ef-9ff6-178d10fd06ea service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:19:58.925222 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [req-b900323b-a1f2-4c9e-9bf6-a60bcaffa4bb req-ff215967-d6ca-45ef-9ff6-178d10fd06ea service nova] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:19:58.937386 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.compute.server_external_events [req-b900323b-a1f2-4c9e-9bf6-a60bcaffa4bb req-ff215967-d6ca-45ef-9ff6-178d10fd06ea service nova] Creating event network-vif-deleted:0c4c3de8-0099-4bf6-aba3-58227e338f77 for instance 268b2363-bee8-4f04-a236-5b2a92fdd9d2 on hv-cinder-84762 Jun 25 16:19:58.942632 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [req-b900323b-a1f2-4c9e-9bf6-a60bcaffa4bb req-ff215967-d6ca-45ef-9ff6-178d10fd06ea service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030354 Jun 25 16:19:58.943491 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 502/1007] 10.222.0.13 () {64 vars in 1317 bytes} [Sat Jun 25 16:19:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 25 16:19:59.102529 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8ede3983-0d46-4719-a200-a2a7016e9743 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:19:59.103244 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-8ede3983-0d46-4719-a200-a2a7016e9743 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 268b2363-bee8-4f04-a236-5b2a92fdd9d2] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:19:59.109803 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8ede3983-0d46-4719-a200-a2a7016e9743 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:19:59.110243 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8ede3983-0d46-4719-a200-a2a7016e9743 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:19:59.110995 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8ede3983-0d46-4719-a200-a2a7016e9743 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:19:59.111424 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-8ede3983-0d46-4719-a200-a2a7016e9743 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:19:59.174286 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.policy [None req-8ede3983-0d46-4719-a200-a2a7016e9743 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef599055aed42f3a97fb30bba553fb0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bb30b042f3422faf43af82b27b37a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117793) authorize /opt/stack/nova/nova/policy.py:199}} Jun 25 16:19:59.182685 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8ede3983-0d46-4719-a200-a2a7016e9743 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2" status: 200 len: 1223 microversion: 2.1 time: 0.084292 Jun 25 16:19:59.183260 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 506/1008] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:19:59 2022] GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 25 16:20:00.205974 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-48e50e96-e179-408e-bef5-b0fd809dc6b7 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:20:00.207136 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-48e50e96-e179-408e-bef5-b0fd809dc6b7 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 268b2363-bee8-4f04-a236-5b2a92fdd9d2] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:20:00.218456 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-48e50e96-e179-408e-bef5-b0fd809dc6b7 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:20:00.219214 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-48e50e96-e179-408e-bef5-b0fd809dc6b7 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:20:00.220751 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-48e50e96-e179-408e-bef5-b0fd809dc6b7 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:20:00.221488 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-48e50e96-e179-408e-bef5-b0fd809dc6b7 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:20:00.235928 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.wsgi [None req-48e50e96-e179-408e-bef5-b0fd809dc6b7 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] HTTP exception thrown: Instance 268b2363-bee8-4f04-a236-5b2a92fdd9d2 could not be found. Jun 25 16:20:00.238187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-48e50e96-e179-408e-bef5-b0fd809dc6b7 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Request method failure captured: Jun 25 16:20:00.238187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: request: GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2 HTTP/1.1 Jun 25 16:20:00.238187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept: application/json Jun 25 16:20:00.238187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept-Encoding: identity Jun 25 16:20:00.238187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Connection: close Jun 25 16:20:00.238187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Length: 0 Jun 25 16:20:00.238187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Type: application/json Jun 25 16:20:00.238187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Host: 10.222.0.13 Jun 25 16:20:00.238187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Openstack-System-Scope: None Jun 25 16:20:00.238187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: User-Agent: python-urllib3/1.26.9 Jun 25 16:20:00.238187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Auth-Token: gAAAAABitzQb-xw95mjecey84BRjb_sUuTti5eEkBXvXkQMog8OEulHRzkQ55Yt_C-J3nkeMNJZWKrD6E7TkI2e1wqtLNkmM1pQxFbwGdu_pPimUhn1tuo1_zNrTPVSUQxqUL9j2ZrMXyaoX2LbVyOCGwF8jj877nxLXfggjnLUjUGa6alxlsdk Jun 25 16:20:00.238187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Id: None Jun 25 16:20:00.238187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Name: None Jun 25 16:20:00.238187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Identity-Status: Confirmed Jun 25 16:20:00.238187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Is-Admin-Project: True Jun 25 16:20:00.238187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Id: default Jun 25 16:20:00.238187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Name: Default Jun 25 16:20:00.238187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Id: c5bb30b042f3422faf43af82b27b37a5 Jun 25 16:20:00.238187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Name: tempest-TestVolumeBootPattern-647003375 Jun 25 16:20:00.238187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Role: reader,member Jun 25 16:20:00.238187 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Roles: reader,member Jun 25 16:20:00.239838 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c5bb30b042f3422faf43af82b27b37a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c5bb30b042f3422faf43af82b27b37a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c5bb30b042f3422faf43af82b27b37a5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c5bb30b042f3422faf43af82b27b37a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:20:00.239838 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant: tempest-TestVolumeBootPattern-647003375 Jun 25 16:20:00.239838 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Id: c5bb30b042f3422faf43af82b27b37a5 Jun 25 16:20:00.239838 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Name: tempest-TestVolumeBootPattern-647003375 Jun 25 16:20:00.239838 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User: tempest-TestVolumeBootPattern-647003375-project Jun 25 16:20:00.239838 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Id: default Jun 25 16:20:00.239838 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Name: Default Jun 25 16:20:00.239838 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Id: 0ef599055aed42f3a97fb30bba553fb0 Jun 25 16:20:00.239838 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Name: tempest-TestVolumeBootPattern-647003375-project Jun 25 16:20:00.239838 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: method: > Jun 25 16:20:00.239838 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: exception: Instance 268b2363-bee8-4f04-a236-5b2a92fdd9d2 could not be found. Jun 25 16:20:00.239838 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: action_args: {'id': '268b2363-bee8-4f04-a236-5b2a92fdd9d2'} Jun 25 16:20:00.240723 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:20:00.240723 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:20:00.240723 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:20:00.240723 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:20:00.240723 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:20:00.240723 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:20:00.240723 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:20:00.240723 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:20:00.240723 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:20:00.240723 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:20:00.240723 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 268b2363-bee8-4f04-a236-5b2a92fdd9d2 could not be found. Jun 25 16:20:00.240723 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:20:00.240723 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:20:00.240723 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:20:00.240723 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:20:00.240723 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:20:00.240723 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:20:00.240723 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:20:00.240723 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:20:00.240723 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:20:00.242299 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:20:00.242299 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 16:20:00.242299 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 16:20:00.242299 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:20:00.242299 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:20:00.242299 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:20:00.242299 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:20:00.242299 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 268b2363-bee8-4f04-a236-5b2a92fdd9d2 could not be found. Jun 25 16:20:00.242299 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:20:00.242299 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:20:00.242299 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:20:00.242299 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:20:00.242299 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:20:00.242299 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:20:00.242299 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:20:00.242299 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:20:00.242299 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 268b2363-bee8-4f04-a236-5b2a92fdd9d2 could not be found. Jun 25 16:20:00.242299 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:20:00.243953 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-48e50e96-e179-408e-bef5-b0fd809dc6b7 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Returning 404 to user: Instance 268b2363-bee8-4f04-a236-5b2a92fdd9d2 could not be found. {{(pid=117794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:20:00.243953 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-48e50e96-e179-408e-bef5-b0fd809dc6b7 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2" status: 404 len: 111 microversion: 2.1 time: 0.041728 Jun 25 16:20:00.243953 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 503/1009] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:20:00 2022] GET /compute/v2.1/servers/268b2363-bee8-4f04-a236-5b2a92fdd9d2 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:20:00.688257 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f76161eb-a5e0-4362-af52-0d07d5f9b3b9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:20:00.688831 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.compute.api [None req-f76161eb-a5e0-4362-af52-0d07d5f9b3b9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 3193adb5-3665-405c-b68c-30023d88105d] Fetching instance by UUID {{(pid=117793) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:20:00.696438 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f76161eb-a5e0-4362-af52-0d07d5f9b3b9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:20:00.696919 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f76161eb-a5e0-4362-af52-0d07d5f9b3b9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:20:00.697679 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f76161eb-a5e0-4362-af52-0d07d5f9b3b9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:20:00.698120 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG oslo_concurrency.lockutils [None req-f76161eb-a5e0-4362-af52-0d07d5f9b3b9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117793) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:20:00.711721 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.wsgi [None req-f76161eb-a5e0-4362-af52-0d07d5f9b3b9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] HTTP exception thrown: Instance 3193adb5-3665-405c-b68c-30023d88105d could not be found. Jun 25 16:20:00.713340 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f76161eb-a5e0-4362-af52-0d07d5f9b3b9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Request method failure captured: Jun 25 16:20:00.713340 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: request: DELETE /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d HTTP/1.1 Jun 25 16:20:00.713340 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept: application/json Jun 25 16:20:00.713340 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Accept-Encoding: identity Jun 25 16:20:00.713340 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Connection: close Jun 25 16:20:00.713340 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Length: 0 Jun 25 16:20:00.713340 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Content-Type: application/json Jun 25 16:20:00.713340 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Host: 10.222.0.13 Jun 25 16:20:00.713340 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Openstack-System-Scope: None Jun 25 16:20:00.713340 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: User-Agent: python-urllib3/1.26.9 Jun 25 16:20:00.713340 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Auth-Token: gAAAAABitzQb-xw95mjecey84BRjb_sUuTti5eEkBXvXkQMog8OEulHRzkQ55Yt_C-J3nkeMNJZWKrD6E7TkI2e1wqtLNkmM1pQxFbwGdu_pPimUhn1tuo1_zNrTPVSUQxqUL9j2ZrMXyaoX2LbVyOCGwF8jj877nxLXfggjnLUjUGa6alxlsdk Jun 25 16:20:00.713340 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Id: None Jun 25 16:20:00.713340 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Domain-Name: None Jun 25 16:20:00.713340 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Identity-Status: Confirmed Jun 25 16:20:00.713340 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Is-Admin-Project: True Jun 25 16:20:00.713340 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Id: default Jun 25 16:20:00.713340 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Domain-Name: Default Jun 25 16:20:00.713340 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Id: c5bb30b042f3422faf43af82b27b37a5 Jun 25 16:20:00.713340 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Project-Name: tempest-TestVolumeBootPattern-647003375 Jun 25 16:20:00.713340 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Role: reader,member Jun 25 16:20:00.713340 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Roles: reader,member Jun 25 16:20:00.714909 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c5bb30b042f3422faf43af82b27b37a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c5bb30b042f3422faf43af82b27b37a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c5bb30b042f3422faf43af82b27b37a5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c5bb30b042f3422faf43af82b27b37a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:20:00.714909 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant: tempest-TestVolumeBootPattern-647003375 Jun 25 16:20:00.714909 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Id: c5bb30b042f3422faf43af82b27b37a5 Jun 25 16:20:00.714909 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-Tenant-Name: tempest-TestVolumeBootPattern-647003375 Jun 25 16:20:00.714909 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User: tempest-TestVolumeBootPattern-647003375-project Jun 25 16:20:00.714909 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Id: default Jun 25 16:20:00.714909 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Domain-Name: Default Jun 25 16:20:00.714909 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Id: 0ef599055aed42f3a97fb30bba553fb0 Jun 25 16:20:00.714909 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: X-User-Name: tempest-TestVolumeBootPattern-647003375-project Jun 25 16:20:00.714909 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: method: > Jun 25 16:20:00.714909 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: exception: Instance 3193adb5-3665-405c-b68c-30023d88105d could not be found. Jun 25 16:20:00.714909 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: action_args: {'id': '3193adb5-3665-405c-b68c-30023d88105d'} Jun 25 16:20:00.715691 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:20:00.715691 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:20:00.715691 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:20:00.715691 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:20:00.715691 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:20:00.715691 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:20:00.715691 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:20:00.715691 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:20:00.715691 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:20:00.715691 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:20:00.715691 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3193adb5-3665-405c-b68c-30023d88105d could not be found. Jun 25 16:20:00.715691 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:20:00.715691 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:20:00.715691 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:20:00.715691 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:20:00.715691 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:20:00.715691 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:20:00.715691 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:20:00.715691 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:20:00.715691 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:20:00.717248 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:20:00.717248 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 25 16:20:00.717248 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 25 16:20:00.717248 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 25 16:20:00.717248 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 25 16:20:00.717248 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:20:00.717248 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:20:00.717248 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:20:00.717248 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:20:00.717248 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3193adb5-3665-405c-b68c-30023d88105d could not be found. Jun 25 16:20:00.717248 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:20:00.717248 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:20:00.717248 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:20:00.717248 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:20:00.717248 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:20:00.717248 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:20:00.717248 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:20:00.717248 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:20:00.717248 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3193adb5-3665-405c-b68c-30023d88105d could not be found. Jun 25 16:20:00.717248 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: ERROR nova.api.openstack.wsgi Jun 25 16:20:00.719019 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-f76161eb-a5e0-4362-af52-0d07d5f9b3b9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Returning 404 to user: Instance 3193adb5-3665-405c-b68c-30023d88105d could not be found. {{(pid=117793) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:20:00.719019 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-f76161eb-a5e0-4362-af52-0d07d5f9b3b9 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "DELETE /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d" status: 404 len: 111 microversion: 2.1 time: 0.032629 Jun 25 16:20:00.719019 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 507/1010] 10.222.0.13 () {58 vars in 1238 bytes} [Sat Jun 25 16:20:00 2022] DELETE /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:20:00.723592 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-98f258a4-be00-4825-86cf-204a9d37fb71 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '>' {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:20:00.724203 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.compute.api [None req-98f258a4-be00-4825-86cf-204a9d37fb71 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] [instance: 3193adb5-3665-405c-b68c-30023d88105d] Fetching instance by UUID {{(pid=117794) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 25 16:20:00.730445 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-98f258a4-be00-4825-86cf-204a9d37fb71 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:20:00.730898 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-98f258a4-be00-4825-86cf-204a9d37fb71 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:20:00.731659 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-98f258a4-be00-4825-86cf-204a9d37fb71 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 25 16:20:00.732094 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG oslo_concurrency.lockutils [None req-98f258a4-be00-4825-86cf-204a9d37fb71 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Lock "53447464-e1f9-46ac-a935-41c9e2d241f6" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117794) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 25 16:20:00.745693 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.wsgi [None req-98f258a4-be00-4825-86cf-204a9d37fb71 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] HTTP exception thrown: Instance 3193adb5-3665-405c-b68c-30023d88105d could not be found. Jun 25 16:20:00.747194 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-98f258a4-be00-4825-86cf-204a9d37fb71 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Request method failure captured: Jun 25 16:20:00.747194 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: request: GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d HTTP/1.1 Jun 25 16:20:00.747194 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept: application/json Jun 25 16:20:00.747194 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Accept-Encoding: identity Jun 25 16:20:00.747194 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Connection: close Jun 25 16:20:00.747194 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Length: 0 Jun 25 16:20:00.747194 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Content-Type: application/json Jun 25 16:20:00.747194 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Host: 10.222.0.13 Jun 25 16:20:00.747194 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Openstack-System-Scope: None Jun 25 16:20:00.747194 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: User-Agent: python-urllib3/1.26.9 Jun 25 16:20:00.747194 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Auth-Token: gAAAAABitzQb-xw95mjecey84BRjb_sUuTti5eEkBXvXkQMog8OEulHRzkQ55Yt_C-J3nkeMNJZWKrD6E7TkI2e1wqtLNkmM1pQxFbwGdu_pPimUhn1tuo1_zNrTPVSUQxqUL9j2ZrMXyaoX2LbVyOCGwF8jj877nxLXfggjnLUjUGa6alxlsdk Jun 25 16:20:00.747194 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Id: None Jun 25 16:20:00.747194 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Domain-Name: None Jun 25 16:20:00.747194 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Identity-Status: Confirmed Jun 25 16:20:00.747194 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Is-Admin-Project: True Jun 25 16:20:00.747194 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Id: default Jun 25 16:20:00.747194 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Domain-Name: Default Jun 25 16:20:00.747194 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Id: c5bb30b042f3422faf43af82b27b37a5 Jun 25 16:20:00.747194 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Project-Name: tempest-TestVolumeBootPattern-647003375 Jun 25 16:20:00.747194 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Role: reader,member Jun 25 16:20:00.747194 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Roles: reader,member Jun 25 16:20:00.748828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c5bb30b042f3422faf43af82b27b37a5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c5bb30b042f3422faf43af82b27b37a5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c5bb30b042f3422faf43af82b27b37a5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c5bb30b042f3422faf43af82b27b37a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}] Jun 25 16:20:00.748828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant: tempest-TestVolumeBootPattern-647003375 Jun 25 16:20:00.748828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Id: c5bb30b042f3422faf43af82b27b37a5 Jun 25 16:20:00.748828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-Tenant-Name: tempest-TestVolumeBootPattern-647003375 Jun 25 16:20:00.748828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User: tempest-TestVolumeBootPattern-647003375-project Jun 25 16:20:00.748828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Id: default Jun 25 16:20:00.748828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Domain-Name: Default Jun 25 16:20:00.748828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Id: 0ef599055aed42f3a97fb30bba553fb0 Jun 25 16:20:00.748828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: X-User-Name: tempest-TestVolumeBootPattern-647003375-project Jun 25 16:20:00.748828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: method: > Jun 25 16:20:00.748828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: exception: Instance 3193adb5-3665-405c-b68c-30023d88105d could not be found. Jun 25 16:20:00.748828 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: action_args: {'id': '3193adb5-3665-405c-b68c-30023d88105d'} Jun 25 16:20:00.749909 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: {{(pid=117794) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 25 16:20:00.749909 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:20:00.749909 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 25 16:20:00.749909 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 25 16:20:00.749909 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 25 16:20:00.749909 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 25 16:20:00.749909 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 25 16:20:00.749909 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 25 16:20:00.749909 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 25 16:20:00.749909 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 25 16:20:00.749909 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3193adb5-3665-405c-b68c-30023d88105d could not be found. Jun 25 16:20:00.749909 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:20:00.749909 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:20:00.749909 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:20:00.749909 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:20:00.749909 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:20:00.749909 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:20:00.749909 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 25 16:20:00.749909 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 25 16:20:00.749909 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 25 16:20:00.751454 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 25 16:20:00.751454 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 25 16:20:00.751454 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 25 16:20:00.751454 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 25 16:20:00.751454 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 25 16:20:00.751454 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 25 16:20:00.751454 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 25 16:20:00.751454 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3193adb5-3665-405c-b68c-30023d88105d could not be found. Jun 25 16:20:00.751454 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:20:00.751454 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 25 16:20:00.751454 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:20:00.751454 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 25 16:20:00.751454 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 25 16:20:00.751454 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 25 16:20:00.751454 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 25 16:20:00.751454 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 25 16:20:00.751454 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3193adb5-3665-405c-b68c-30023d88105d could not be found. Jun 25 16:20:00.751454 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: ERROR nova.api.openstack.wsgi Jun 25 16:20:00.752881 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: DEBUG nova.api.openstack.wsgi [None req-98f258a4-be00-4825-86cf-204a9d37fb71 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Returning 404 to user: Instance 3193adb5-3665-405c-b68c-30023d88105d could not be found. {{(pid=117794) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 25 16:20:00.752881 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO nova.api.openstack.requestlog [None req-98f258a4-be00-4825-86cf-204a9d37fb71 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d" status: 404 len: 111 microversion: 2.1 time: 0.029006 Jun 25 16:20:00.752881 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: [pid: 117794|app: 0|req: 504/1011] 10.222.0.13 () {58 vars in 1235 bytes} [Sat Jun 25 16:20:00 2022] GET /compute/v2.1/servers/3193adb5-3665-405c-b68c-30023d88105d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 25 16:20:02.100731 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: DEBUG nova.api.openstack.wsgi [None req-8a935e03-701c-44af-bc8b-8ca1a2fd0334 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] Calling method '.version_select at 0x7f65bb551160>' {{(pid=117793) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 25 16:20:02.119395 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO nova.api.openstack.requestlog [None req-8a935e03-701c-44af-bc8b-8ca1a2fd0334 tempest-TestVolumeBootPattern-647003375 tempest-TestVolumeBootPattern-647003375-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-38770479" status: 202 len: 0 microversion: 2.1 time: 0.022500 Jun 25 16:20:02.119978 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: [pid: 117793|app: 0|req: 508/1012] 10.222.0.13 () {58 vars in 1256 bytes} [Sat Jun 25 16:20:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-38770479 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 25 16:21:20.405560 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 16:21:20.406514 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Sat Jun 25 16:21:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 16:21:23.095425 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 16:21:23.096474 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Sat Jun 25 16:21:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 16:21:57.251601 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 16:21:57.252646 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Sat Jun 25 16:21:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 16:22:56.251000 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 16:22:56.251790 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Sat Jun 25 16:22:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 16:22:56.956040 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 16:22:56.956505 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Sat Jun 25 16:22:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 16:23:13.890846 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 16:23:13.891358 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Sat Jun 25 16:23:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 16:24:40.418943 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 16:24:40.420118 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Sat Jun 25 16:24:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 16:24:43.109741 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 16:24:43.110821 dv-cinder-847620-2-iscsi devstack@n-api.service[117794]: Sat Jun 25 16:24:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 25 16:25:17.264853 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 25 16:25:17.265540 dv-cinder-847620-2-iscsi devstack@n-api.service[117793]: Sat Jun 25 16:25:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!